US20190361258A1 - Structured light projection and imaging - Google Patents
Structured light projection and imaging Download PDFInfo
- Publication number
- US20190361258A1 US20190361258A1 US16/535,024 US201916535024A US2019361258A1 US 20190361258 A1 US20190361258 A1 US 20190361258A1 US 201916535024 A US201916535024 A US 201916535024A US 2019361258 A1 US2019361258 A1 US 2019361258A1
- Authority
- US
- United States
- Prior art keywords
- light
- light beams
- optical
- subject matter
- disclosed subject
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
- G01B11/2513—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/16—Measuring arrangements characterised by the use of optical techniques for measuring the deformation in a solid, e.g. optical strain gauge
- G01B11/167—Measuring arrangements characterised by the use of optical techniques for measuring the deformation in a solid, e.g. optical strain gauge by projecting a pattern on the object
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/22—Measuring arrangements characterised by the use of optical techniques for measuring depth
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
- G01C3/02—Details
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0025—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
- G02B27/0037—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration with diffracting elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/09—Beam shaping, e.g. changing the cross-sectional area, not otherwise provided for
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4233—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive element [DOE] contributing to a non-imaging application
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4233—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive element [DOE] contributing to a non-imaging application
- G02B27/425—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having a diffractive element [DOE] contributing to a non-imaging application in illumination systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4272—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having plural diffractive elements positioned sequentially along the optical path
-
- G06K9/2036—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/145—Illumination specially adapted for pattern recognition, e.g. using gratings
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/254—Image signal generators using stereoscopic image cameras in combination with electromagnetic radiation sources for illuminating objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
-
- H04N5/332—
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/10—Projectors with built-in or built-on screen
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/54—Accessories
- G03B21/56—Projection screens
- G03B21/60—Projection screens characterised by the nature of the surface
- G03B21/606—Projection screens characterised by the nature of the surface for relief projection
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Optics & Photonics (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Electromagnetism (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Artificial Intelligence (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Diffracting Gratings Or Hologram Optical Elements (AREA)
- Lenses (AREA)
- Exposure And Positioning Against Photoresist Photosensitive Materials (AREA)
- Photometry And Measurement Of Optical Pulse Characteristics (AREA)
- Mechanical Light Control Or Optical Switches (AREA)
Abstract
An optical system, including: (a) an emitter array including a plurality of individual emitters, wherein each emitter in the emitter array is operable to emit a light beam which is characterized by a native beam width; (b) an optical subunit, operable to transform a plurality of light beams emitted by the emitter array, wherein each of the transformed light beams is characterized by an expanded beam width that is wider than the native beam width of the corresponding light beam and is wider than a facilitating beam width; and (c) a diffractive optical element that is capable of diffracting the transformed light beams to provide light patterns whose angular resolution meets a light pattern target angular resolution criteria.
Description
- The present application claims priority from U.S. Provisional Patent Application No. 62/036,158.
- The invention is related to systems, methods, and computer program products for structured light projection and imaging.
- Sazbon et al. describe a method of this sort for range estimation in “Qualitative Real-Time Range Extraction for Preplanned Scene Partitioning Using Laser Beam Coding,” Pattern Recognition Letters 26 (2005), pages 1772-1781, which is incorporated herein by reference. A phase-only filter codes the laser beam into M different diffraction patterns, corresponding to M different range segments in the workspace. Thus, each plane in the illuminated scene is irradiated with the pattern corresponding to the range of the plane from the light source. A common camera can be used to capture images of the scene, which may be processed to determine the ranges of objects in the scene. The authors describe an iterative procedure for designing the phase-only filter based on the Gerchberg-Saxton algorithm.
- US Patent Publication No. 2011/0158508 to Shpunt et al. discloses a method for mapping which uses a diffractive optical element and includes projecting onto an object a pattern of multiple spots having respective positions and shapes, such that the positions of the spots in the pattern are uncorrelated, while the shapes share a common characteristic. An image of the spots on the object is captured and processed so as to derive a three-dimensional (3D) map of the object.
- U.S. Pat. Nos. 8,090,194, 8,208,719 and 8,538,166 to Gordon et al. and International Publication No. WO2008062407 also to Gordon et al. disclose various aspects of structured light projection and imaging as well features, hardware and algorithms used in structured light projection and imaging.
- In accordance with an aspect of the presently disclosed subject matter, there is provided an optical system, including: (a) an emitter array including a plurality of individual emitters, wherein each emitter in the emitter array is operable to emit a light beam which is characterized by a native beam width; (b) an optical subunit, operable to transform a plurality of light beams emitted by the emitter array, wherein each of the transformed light beams is characterized by an expanded beam width that is wider than the native beam width of the corresponding light beam and is wider than a facilitating beam width; and (c) a diffractive optical element (DOE) that is capable of diffracting the transformed light beams to provide light patterns whose angular resolution meets a light pattern target angular resolution criteria.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is an optical assembly including a plurality of optical elements.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each emitter in the emitter array is operable to emit a light beam whose native beam width is narrower than the facilitating beam width by at least one order of magnitude.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is an optical assembly including a plurality of optical elements having a common optical axis common to the plurality of optical elements.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is operable to transform the plurality of light beams to provide the plurality of transformed light beams using transforming optical components included in the optical subunit, wherein the transforming optical components are common to the plurality of light beams.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the emitter array and the optical subunit are positioned relative to one another such that the optical subunit further transforms the plurality of light beams by deflecting the plurality of light beams so that the plurality of transformed light beams are projected onto the diffractive optical element at different angles of incidence, resulting in providing of a structured light pattern which includes the plurality of light patterns.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each emitter in the emitter array is operable to emit a light beam, out of the plurality of light beams, which is characterized by a first beam divergence; wherein the optical subunit is further operable to transform the plurality of light beams so that each of the transformed light beams is characterized by a second beam divergence that is smaller than the first beam divergence of the corresponding light beam.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein for each individual emitter of the emitter array there is at least one other individual emitter of the emitter array positioned at a distance which is at least 10 times smaller than any beam-width of any transformed light beam out of the plurality of transformed light beams.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the expanded beam widths of each of the plurality of transformed light beams is at least 3 times larger than the native beam width of the corresponding light beams.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is a telecentric optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of individual emitters are positioned on a focal plane of the optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of light beams propagates to the optical subunit in substantially parallel paths.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of light patterns provided by the diffractive optical element are copies of a predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the copies of the predetermined light pattern are adjacent to each other.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the utilization of the single diffractive optical element by the optical system for the generating of the plurality of copies of the predetermined light pattern facilitates projection of a high contrast and high clarity overall output pattern of the optical system.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each provided copy of the predetermined light pattern partly overlaps at least one other provided copy of the predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the predetermined light pattern includes multiple copies of a repeated subpattern, wherein in each provided copy of the predetermined light pattern at least one subpattern overlaps a subpattern of at least one other provided copy of the predetermined light pattern generated by light originating from another light emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, further including an emitter array control system which is configured and operable to control activation of different subgroups of emitters of the emitter array, thereby resulting in providing of offset overall output patterns of the optical system at different times.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, further including projection optics to image at least a part of a structured light pattern which includes the plurality of light patterns onto an object, an imaging sensor adapted to capture an image of the object with the structured light pattern projected thereon, and a processing unit adapted to process the image to determine range parameters.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit includes a plurality of optical elements having a common optical axis common to the plurality of optical elements, wherein the common optical axis is folded at least once.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each emitter of the emitter array is a vertical-cavity surface-emitting laser (VCSEL) emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the emitter array is dense with individual emitters of coherent light beams, thereby enabling spatially efficient providing of a high energy structured light pattern.
- In accordance with an aspect of the presently disclosed subject matter, there is provided an optical system, including: (a) an emitter array including a plurality of individual emitters, wherein each emitter in the emitter array is operable to emit a light beam which is characterized by a first beam divergence; (b) an optical subunit, operable to transform a plurality of light beams emitted by the emitter array, wherein each of the transformed light beams is characterized by a second beam divergence that is smaller than the first beam divergence of the corresponding light beam; and (c) a diffractive optical element (DOE) capable of diffracting the transformed light beams to provide light patterns.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is an optical assembly including a plurality of optical elements.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein a facilitating beam divergence is defined for the DOE so that incidence upon the DOE of coherent light beams whose divergence is lower than the facilitating beam divergence result in provision of light patterns whose contrast meets a light pattern target contrast criteria; wherein the second beam divergences of the plurality of transformed light beams are lower than the facilitating beam divergence.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each emitter in the emitter array is operable to emit a light beam whose first beam divergence is larger than the facilitating beam divergence by at least one order of magnitude.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is an optical assembly including a plurality of optical elements having a common optical axis common to the plurality of optical elements.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is operable to transform the plurality of light beams to provide the plurality of transformed light beams using transforming optical components included in the optical subunit, wherein the transforming optical elements are common to the plurality of light beams.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the emitter array and the optical subunit are positioned relative to one another such that the optical subunit further transform the plurality of light beams by deflecting the plurality of light beams so that the plurality of transformed light beams are projected onto the diffractive optical element at different angles of incidence, resulting in providing of a plurality of light patterns by the diffractive optical element.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is a telecentric optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of individual emitters are positioned on a focal plane of the optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of light beams propagates to the optical subunit in substantially parallel paths.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of light patterns provided by the diffractive optical element are copies of a predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the copies of the predetermined light pattern are adjacent to each other.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the utilization of the single diffractive optical element by the optical system for the generating of the plurality of copies of the predetermined light pattern facilitates projection of a high contrast and high clarity overall output pattern of the optical system.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each provided copy of the predetermined light pattern partly overlaps at least one other provided copy of the predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the predetermined light pattern includes multiple copies of a repeated subpattern, wherein in each provided copy of the predetermined light pattern at least one subpattern overlaps a subpattern of at least one other provided copy of the predetermined light pattern generated by light originating from another light emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, further including an emitter array control system which is configured and operable to control activation of different subgroups of emitters of the emitter array, thereby resulting in providing of offset overall output patterns of the optical system at different times.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, further including projection optics to image at least a part of a structured light pattern which includes the plurality of light patterns onto an object, an imaging sensor adapted to capture an image of the object with the structured light pattern projected thereon, and a processing unit adapted to process the image to determine range parameters.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit includes a plurality of optical elements having a common optical axis common to the plurality of optical elements, wherein the common optical axis is folded at least once.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each emitter of the emitter array is a vertical-cavity surface-emitting laser (VCSEL) emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the emitter array is dense with individual emitters of coherent light beams, thereby enabling spatially efficient providing of a high energy structured light pattern.
- In accordance with an aspect of the presently disclosed subject matter, there is provided an optical system, including: (a) an emitter array including a plurality of individual emitters, wherein each emitter in the emitter array is operable to emit a light beam; (b) an optical subunit, operable to: (i) transform a plurality of light beams emitted by the emitter array, wherein the transformation includes expansion and/or collimation of the plurality of light beams; and (ii) to direct the plurality of transformed light beams onto the diffractive optical element at different angles of incidence, resulting in providing of a plurality of light patterns by the diffractive optical element; and (c) a diffractive optical element (DOE) that is capable of diffracting the transformed light beams to provide light patterns.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein for each individual emitter of the emitter array there is at least one other individual emitter of the emitter array positioned at a distance which is smaller than any beam width of any transformed light beam out of the plurality of transformed light beams.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is an optical assembly including a plurality of optical elements.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit includes a plurality of optical elements having a common optical axis common to the plurality of optical elements.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is operable to transform the plurality of light beams to provide the plurality of transformed light beams using transforming optical components, out of the plurality of optical components, which are common to the plurality of light beams.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the emitter array and the optical subunit are positioned relative to one another such that the optical subunit further transform the plurality of light beams by deflecting the plurality of light beams so that the plurality of transformed light beams are projected onto the diffractive optical element at different angles of incidence, resulting in providing of a plurality of light patterns by the diffractive optical element.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is a telecentric optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of individual emitters are positioned on a focal plane of the optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of light beams propagates to the optical subunit in substantially parallel paths.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of light patterns provided by the diffractive optical element are copies of a predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the copies of the predetermined light pattern are adjacent to each other.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the utilization of the single diffractive optical element by the optical system for the generating of the plurality of copies of the predetermined light pattern facilitates projection of a high contrast and high clarity overall output pattern of the optical system.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each provided copy of the predetermined light pattern partly overlaps at least one other provided copy of the predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the predetermined light pattern includes multiple copies of a repeated subpattern, wherein in each provided copy of the predetermined light pattern at least one subpattern overlaps a subpattern of at least one other provided copy of the predetermined light pattern generated by light originating from another light emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, further including an emitter array control system which is configured and operable to control activation of different subgroups of emitters of the emitter array, thereby resulting in providing of offset overall output patterns of the optical system at different times.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, further including projection optics to image at least a part of a structured light pattern which includes the plurality of light patterns onto an object, an imaging sensor adapted to capture an image of the object with the structured light pattern projected thereon, and a processing unit adapted to process the image to determine range parameters.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit includes a plurality of optical elements having a common optical axis common to the plurality of optical elements, wherein the common optical axis is folded at least once.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each emitter of the emitter array is a vertical-cavity surface-emitting laser (VCSEL) emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the emitter array is dense with individual emitters of coherent light beams, thereby enabling spatially efficient providing of a high energy structured light pattern.
- In accordance with an aspect of the presently disclosed subject matter, there is provided an optical system, including: (a) an emitter array including a plurality of individual emitters arranged so as to form a planar emission plane, wherein each emitter in the emitter array is operable to emit a light beam; (b) an optical subunit, operable to: (i) transform a plurality of light beams emitted by the emitter array, wherein the transformation includes expansion and/or collimation of the plurality of light beams; and (ii) to direct the plurality of transformed light beams onto the diffractive optical element at different angles of incidence, resulting in providing of a plurality of light patterns by the diffractive optical element; and (c) a diffractive optical element (DOE) that is capable of diffracting the transformed light beams to provide light patterns.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit includes a plurality of optical elements having a common optical axis common to the plurality of optical elements.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is operable to transform the plurality of light beams to provide the plurality of transformed light beams using transforming optical components, out of the plurality of optical components, which are common to the plurality of light beams.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the emitter array and the optical subunit are positioned relative to one another such that the optical subunit further transform the plurality of light beams by deflecting the plurality of light beams so that the plurality of transformed light beams are projected onto the diffractive optical element at different angles of incidence, resulting in providing of a plurality of light patterns by the diffractive optical element.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is a telecentric optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of individual emitters are positioned on a focal plane of the optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of light beams propagates to the optical subunit in substantially parallel paths.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of light patterns provided by the diffractive optical element are copies of a predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the copies of the predetermined light pattern are adjacent to each other.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the utilization of the single diffractive optical element by the optical system for the generating of the plurality of copies of the predetermined light pattern facilitates projection of a high contrast and high clarity overall output pattern of the optical system.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each provided copy of the predetermined light pattern partly overlaps at least one other provided copy of the predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the predetermined light pattern includes multiple copies of a repeated subpattern, wherein in each provided copy of the predetermined light pattern at least one subpattern overlaps a subpattern of at least one other provided copy of the predetermined light pattern generated by light originating from another light emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, further including an emitter array control system which is configured and operable to control activation of different subgroups of emitters of the emitter array, thereby resulting in providing of offset overall output patterns of the optical system at different times.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, further including projection optics to image at least a part of a structured light pattern which includes the plurality of light patterns onto an object, an imaging sensor adapted to capture an image of the object with the structured light pattern projected thereon, and a processing unit adapted to process the image to determine range parameters.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit includes a plurality of optical elements having a common optical axis common to the plurality of optical elements, wherein the common optical axis is folded at least once.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each emitter of the emitter array is a vertical-cavity surface-emitting laser (VCSEL) emitter.
- In accordance with an aspect of the presently disclosed subject matter, there is provided an optical system, including: (a) an emitter array including a plurality of individual emitters, wherein each emitter in the emitter array is operable to emit a light beam; (b) an optical subunit, operable to transform a plurality of light beams emitted by the emitter array, wherein the transformation includes expansion and/or collimation of the plurality of light beams; (c) a diffractive optical element (DOE) that is capable of diffracting the transformed light beams to provide light patterns; wherein a combination of the optical subunit and the diffractive optical element is characterized by a distortion function; wherein the plurality of individual emitters are arranged in a non-uniform configuration whose relation to a predefined uniform grid is an inverse function of the distortion function.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is operable to direct the plurality of transformed light beams onto the diffractive optical element at different angles of incidence, resulting in providing of a plurality of light patterns by the diffractive optical element.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit is a telecentric optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of individual emitters are positioned on a focal plane of the optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of light beams propagates to the optical subunit in substantially parallel paths.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the plurality of light patterns provided by the diffractive optical element are copies of a predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the copies of the predetermined light pattern are adjacent to each other.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the utilization of the single diffractive optical element by the optical system for the generating of the plurality of copies of the predetermined light pattern facilitates projection of a high contrast and high clarity overall output pattern of the optical system.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each provided copy of the predetermined light pattern partly overlaps at least one other provided copy of the predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the predetermined light pattern includes multiple copies of a repeated subpattern, wherein in each provided copy of the predetermined light pattern at least one subpattern overlaps a subpattern of at least one other provided copy of the predetermined light pattern generated by light originating from another light emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, further including an emitter array control system which is configured and operable to control activation of different subgroups of emitters of the emitter array, thereby resulting in providing of offset overall output patterns of the optical system at different times.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, further including projection optics to image at least a part of a structured light pattern which includes the plurality of light patterns onto an object, an imaging sensor adapted to capture an image of the object with the structured light pattern projected thereon, and a processing unit adapted to process the image to determine range parameters.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein the optical subunit includes a plurality of optical elements having a common optical axis common to the plurality of optical elements, wherein the common optical axis is folded at least once.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a system, wherein each emitter of the emitter array is a vertical-cavity surface-emitting laser (VCSEL) emitter.
- In accordance with an aspect of the presently disclosed subject matter, there is provided a method for projection, the method including: (a) emitting a plurality of light beams, wherein each of the plurality of light beams is characterized by a native beam width; (b) transforming the plurality of light beams so that each of the transformed light beams is characterized by an expanded beam width that is wider than the native beam width of the corresponding light beam and is wider than a facilitating beam width; and (c) diffracting the transformed light beams by a diffractive optical element (DOE) to provide light patterns whose angular resolution meets a light pattern target angular resolution criteria.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the emitting includes emitting the plurality of light beams whose native beam widths are narrower than the facilitating beam width by at least one order of magnitude.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, further including deflecting the plurality of light beams, projecting the plurality of transformed light beams onto the diffractive optical element at different angles of incidence, and providing a plurality of light patterns by the diffractive optical element, wherein the structured light pattern includes the plurality of light patterns.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein each light beam out of the plurality of light beams is characterized by a first beam divergence; wherein the transforming of the plurality of light beams includes transforming the plurality of light beams so that each of the transformed light beams is characterized by a second beam divergence that is smaller than the first beam divergence of the corresponding light beam.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the transforming of the plurality of light beams includes transforming the plurality of light beams so that the expanded beam widths of each of the plurality of transformed light beams is at least 3 times larger than the native beam width of the corresponding light beams.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the transforming is executed by a telecentric optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the transforming is executed by an optical subunit, wherein the emitting is executed by a plurality of individual emitters which are positioned on a focal plane of the optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the plurality of light beams propagates to the optical subunit in substantially parallel paths.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the plurality of light patterns provided by the diffractive optical element are copies of a predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the copies of the predetermined light pattern are adjacent to each other.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the plurality of copies of the predetermined light pattern facilitates projection of a high contrast and high clarity overall output pattern of the optical system.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein each provided copy of the predetermined light pattern partly overlaps at least one other provided copy of the predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the predetermined light pattern includes multiple copies of a repeated subpattern, wherein in each provided copy of the predetermined light pattern at least one subpattern overlaps a subpattern of at least one other provided copy of the predetermined light pattern generated by light originating from another light emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, further including an emitter array control system which is configured and operable to control activation of different subgroups of emitters of the emitter array, thereby resulting in providing of offset overall output patterns of the optical system at different times.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, further including projecting onto an object at least a part of a structured light pattern which includes the plurality of light patterns, capturing an image of the object with the structured light pattern projected thereon, and processing the image to determine range parameters.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the optical subunit includes a plurality of optical elements having a common optical axis common to the plurality of optical elements, wherein the common optical axis is folded at least once.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein each emitter of the emitter array is a vertical-cavity surface-emitting laser (VCSEL) emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the emitter array is dense with individual emitters of coherent light beams, thereby enabling spatially efficient providing of a high energy structured light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the emitter array includes a plurality of individual emitters arranged so as to form a planar emission plane.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein a combination of the optical subunit and the diffractive optical element is characterized by a distortion function; wherein the plurality of individual emitters are arranged in a non-uniform configuration whose relation to a predefined uniform grid is an inverse function of the distortion function.
- In accordance with an aspect of the presently disclosed subject matter, there is provided a method for projection, the method including: (a) emitting a plurality of light beams, wherein each of the plurality of light is characterized by a first beam divergence; (b) transforming the plurality of light beams so that each of the transformed light beams is characterized by a second beam divergence that is smaller than the first beam divergence of the corresponding light beam; and (c) diffracting the transformed light beams by a diffractive optical element (DOE) to provide light patterns.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the optical subunit is. an optical assembly including a plurality of optical elements.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein a facilitating beam divergence is defined for the DOE so that incidence upon the DOE of coherent light beams whose divergence is lower than the facilitating beam divergence result in provision of light patterns whose contrast meets a light pattern target contrast criteria; wherein the second beam divergences of the plurality of transformed light beams are lower than the facilitating beam divergence.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein each emitter in the emitter array is operable to emit a light beam whose first beam divergence is larger than the facilitating beam divergence by at least one order of magnitude.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the optical subunit is an optical assembly including a plurality of optical elements having a common optical axis common to the plurality of optical elements.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the optical subunit is operable to transform the plurality of light beams to provide the plurality of transformed light beams using transforming optical components included in the optical subunit, wherein the transforming optical elements are common to the plurality of light beams.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the emitter array and the optical subunit are positioned relative to one another such that the optical subunit further transform the plurality of light beams by deflecting the plurality of light beams so that the plurality of transformed light beams are projected onto the diffractive optical element at different angles of incidence, resulting in providing of a plurality of light patterns by the diffractive optical element.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the transforming is executed by a telecentric optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the transforming is executed by an optical subunit, wherein the emitting is executed by a plurality of individual emitters which are positioned on a focal plane of the optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the plurality of light beams propagates to the optical subunit in substantially parallel paths.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the plurality of light patterns provided by the diffractive optical element are copies of a predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the copies of the predetermined light pattern are adjacent to each other.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the plurality of copies of the predetermined light pattern facilitates projection of a high contrast and high clarity overall output pattern of the optical system.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein each provided copy of the predetermined light pattern partly overlaps at least one other provided copy of the predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the predetermined light pattern includes multiple copies of a repeated subpattern, wherein in each provided copy of the predetermined light pattern at least one subpattern overlaps a subpattern of at least one other provided copy of the predetermined light pattern generated by light originating from another light emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, further including an emitter array control system which is configured and operable to control activation of different subgroups of emitters of the emitter array, thereby resulting in providing of offset overall output patterns of the optical system at different times.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, further including projecting onto an object at least a part of a structured light pattern which includes the plurality of light patterns, capturing an image of the object with the structured light pattern projected thereon, and processing the image to determine range parameters.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the optical subunit includes a plurality of optical elements having a common optical axis common to the plurality of optical elements, wherein the common optical axis is folded at least once.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein each emitter of the emitter array is a vertical-cavity surface-emitting laser (VCSEL) emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the emitter array is dense with individual emitters of coherent light beams, thereby enabling spatially efficient providing of a high energy structured light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the emitter array includes a plurality of individual emitters arranged so as to form a planar emission plane.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein a combination of the optical subunit and the diffractive optical element is characterized by a distortion function; wherein the plurality of individual emitters are arranged in a non-uniform configuration whose relation to a predefined uniform grid is an inverse function of the distortion function.
- In accordance with an aspect of the presently disclosed subject matter, there is provided a method for projection, the method including: (a) emitting a plurality of light beams; (b) transforming the plurality of light beams, the transforming including expanding and/or collimating of the plurality of light beams; (c) directing the plurality of transformed light beams onto a diffractive optical element at different angles of incidence; and (d) diffracting the plurality of transformed light beams by the diffractive optical element (DOE) to provide a plurality of light patterns; wherein the emitting includes emitting the plurality of light beams by a plurality of individual emitters which are positioned so that for each of the individual emitters there is at least one other individual emitter positioned at a distance which is smaller than any beam width of any transformed light beam out of the plurality of transformed light beams.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the transforming is executed by a telecentric optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the transforming is executed by an optical subunit, wherein the emitting is executed by a plurality of individual emitters which are positioned on a focal plane of the optical subunit.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the plurality of light beams propagates to the optical subunit in substantially parallel paths.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the plurality of light patterns provided by the diffractive optical element are copies of a predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the copies of the predetermined light pattern are adjacent to each other.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the plurality of copies of the predetermined light facilitates projection of a high contrast and high clarity overall output pattern of the optical system.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein each provided copy of the predetermined light pattern partly overlaps at least one other provided copy of the predetermined light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the predetermined light pattern includes multiple copies of a repeated subpattern, wherein in each provided copy of the predetermined light pattern at least one subpattern overlaps a subpattern of at least one other provided copy of the predetermined light pattern generated by light originating from another light emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, further including an emitter array control system which is configured and operable to control activation of different subgroups of emitters of the emitter array, thereby resulting in providing of offset overall output patterns of the optical system at different times.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, further including projecting onto an object at least a part of a structured light pattern which includes the plurality of light patterns, capturing an image of the object with the structured light pattern projected thereon, and processing the image to determine range parameters.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the optical subunit includes a plurality of optical elements having a common optical axis common to the plurality of optical elements, wherein the common optical axis is folded at least once.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein each emitter of the emitter array is a vertical-cavity surface-emitting laser (VCSEL) emitter.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the emitter array is dense with individual emitters of coherent light beams, thereby enabling spatially efficient providing of a high energy structured light pattern.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the emitter array includes a plurality of individual emitters arranged so as to form a planar emission plane.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein a combination of the optical subunit and the diffractive optical element is characterized by a distortion function; wherein the plurality of individual emitters are arranged in a non-uniform configuration whose relation to a predefined uniform grid is an inverse function of the distortion function.
- in accordance with an aspect of the presently disclosed subject matter, there is provided a method, including : (a) obtaining optical characteristics of a doe positioned at a given distance from a light source; (b) obtaining data in respect of a provisional light beams emission layout through the doe; (c) obtaining a target emission layout; and (d) determining an emitters layout based on the target emission layout and based on the provisional light beams emission layout.
- In accordance with an embodiment of the presently disclosed subject matter, there is further provided a method, wherein the determining comprises determining an emitters layout, such that light emitted by a light source positioned at the given distance from the DOE and having a plurality of emitters arranged according to the emitters layout is diffracted through the DOE is characterized by a layout that meets a target emission criterion that is based on the target emission layout.
- In order to understand the invention and to see how it may be carried out in practice, embodiments will now be described, by way of non-limiting example only, with reference to the accompanying drawings, in which:
-
FIGS. 1, 2, 3A and 3B are functional block diagrams illustrating various examples of optical system, in accordance with examples of the presently disclosed subject matter; -
FIGS. 4A and 4B illustrate examples of an optical system within an environment which includes the optical system and a projection of structured light, in accordance with examples of the presently disclosed subject matter; -
FIG. 4C is an exploded view of an example of the projection of an optical system, including projection of structured light made of a plurality of partially overlapping light patterns, in accordance with examples of the presently disclosed subject matter; -
FIGS. 5 and 6 are functional block diagrams illustrating various examples of optical system, in accordance with examples of the presently disclosed subject matter; -
FIG. 7 illustrates an example of an optical system within an environment which includes the optical system and an object, in accordance with examples of the presently disclosed subject matter; -
FIGS. 8, 9 and 10 are functional block diagrams illustrating various examples of optical system, in accordance with examples of the presently disclosed subject matter; -
FIG. 11 illustrates a hexagonal configuration of emitter array in accordance with examples of the presently disclosed subject matter; -
FIGS. 12A through 12G includes diagrams which are related to possible distortions in the light patterns generated by the system ofFIG. 1 , and ways to reduce such distortion, in accordance with examples of the presently disclosed subject matter; -
FIGS. 13, 14 and 15 is a functional block diagram illustrating an example of an optical system, in accordance with examples of the presently disclosed subject matter; -
FIG. 16 is a block diagram illustration of a system according to examples of the presently disclosed subject matter, including support for a remote mode of a 3D capture application feature; -
FIGS. 17-24 are flow charts illustrating examples of various methods for projection, in accordance with examples of the presently disclosed subject matter; and -
FIG. 25 is a flow chart illustrating an example of a method, in accordance with examples of the presently disclosed subject matter. - It will be appreciated that for simplicity and clarity of illustration, elements shown in the figures have not necessarily been drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements.
- In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the invention. However, it will be understood by those skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known methods, procedures, and components have not been described in detail so as not to obscure the present invention.
- In the drawings and descriptions set forth, identical reference numerals indicate those components that are common to different embodiments or configurations.
- Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The materials, methods, and examples provided herein are illustrative only and not intended to be limiting. Except to the extent necessary or inherent in the processes themselves, no particular order to steps or stages of methods and processes described in this disclosure, including the figures, is intended or implied. In many cases the order of process steps may vary without changing the purpose or effect of the methods described.
- Unless specifically stated otherwise, as apparent from the following discussions, it is appreciated that throughout the specification discussions utilizing terms such as “processing”, “computing”, “determining”, “generating”, “configuring”, “selecting”, “defining”, or the like, include action and/or processes of a computer that manipulates and/or transforms data into other data, said data represented as physical quantities, e.g. such as electronic quantities, and/or said data representing the physical objects. The terms “computer”, “processor”, and “controller” should be expansively construed to cover any kind of electronic device, component or unit with data processing capabilities, including, by way of non-limiting example, a personal computer, a server, a computing system, a communication device, a processor (e.g. digital signal processor (DSP), and possibly with embedded memory), a microcontroller, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), etc.), any other electronic computing device, and or any combination thereof.
- The operations in accordance with the teachings herein may be performed by a computer specially constructed for the desired purposes or by a general purpose computer specially configured for the desired purpose by a computer program stored in a computer readable storage medium.
- As used herein, the phrase “for example,” “such as”, “for instance” and variants thereof describe non-limiting embodiments of the presently disclosed subject matter. Reference in the specification to “one case”, “some cases”, “other cases” or variants thereof means that a particular feature, structure or characteristic described in connection with the embodiment(s) is included in at least one embodiment of the presently disclosed subject matter. Thus the appearance of the phrase “one case”, “some cases”, “other cases” or variants thereof does not necessarily refer to the same embodiment(s).
- It is appreciated that certain features of the presently disclosed subject matter, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the presently disclosed subject matter, which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable sub-combination.
- In embodiments of the presently disclosed subject matter one or more stages illustrated in the figures may be executed in a different order and/or one or more groups of stages may be executed simultaneously and vice versa. The figures illustrate a general schematic of the system architecture in accordance with an embodiment of the presently disclosed subject matter. Each module in the figures can be made up of any combination of software, hardware and/or firmware that performs the functions as defined and explained herein. The modules in the figures may be centralized in one location or dispersed over more than one location.
- It should be noted that some examples of the presently disclosed subject matter are not limited in application to the details of construction and the arrangement of the components set forth in the following description or illustrated in the drawings. The invention can be capable of other embodiments or of being practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein is for the purpose of description and should not be regarded as limiting.
- In this document, an element of a drawing that is not described within the scope of the drawing and is labeled with a numeral that has been described in a previous drawing has the same use and description as in the previous drawings. Similarly, an element that is identified in the text by a numeral that does not appear in the drawing described by the text, has the same use and description as in the previous drawings where it was described.
- The drawings in this document may not be to any scale. Different Figs. may use different scales and different scales can be used even within the same drawing, for example different scales for different views of the same object or different scales for the two adjacent objects.
-
FIG. 1 is a functional block diagram illustrating an example ofoptical system 200, in accordance with examples of the presently disclosed subject matter.Optical system 200 can includeemitter array 210 as a light source whose light can be diffracted by diffractiveoptical element 230, after being manipulated byoptical subunit 220. Along this optical path, the light emitted byemitter array 210 is patterned to provide structured light 300 having a corresponding structured light pattern. - While not necessarily coded, the structured light pattern may be a coded light pattern. The term “coded light pattern” (also occasionally referred to as “structured light pattern” and “coded structured light pattern”) is well accepted in the art, and should be construed in a non-limiting way to include patterns which are specially designed so that codewords are assigned to a set of locations (e.g. pixels or pixel neighborhoods) of the pattern. Every coded location (e.g. every coded pixel or coded pixel neighborhoods) has its own codeword, so there is a direct mapping from the codewords to the corresponding coordinates of the location (e.g. pixel or pixel neighborhood) in the pattern. The codewords are symbols (e.g. alphabetic characters such as numbers) which are embedded in the coded pattern, e.g. using any combination of one or more of the following: grey levels, colors, color levels, polarization and geometrical shapes. Examples of coded light pattern are disclosed in various patents and patent applications assigned to the assignee of the present application, such as U.S. Pat. Nos. 8,090,194, 8,538,166, 8,208,719, and International Publication No. WO2008/062407, all of which are hereby incorporated by reference in their entirety.
-
Emitter array 210 includes a plurality ofindividual emitters 212, and eachemitter 212 in theemitter array 210 is operable to emit alight beam 110.Optical subunit 220 is operable to transform a plurality oflight beams 110 emitted byemitter array 210; and diffractive optical element (DOE) 230 is capable of diffracting the transformedlight beams 130 so as to provide light patterns. - Diffractive optical element (DOE) 230 is capable of diffracting an incident coherent to provide a light pattern. The term “diffractive optical element” (commonly abbreviated to DOE) is well accepted in the art, and should be construed in a non-limiting way to include phase elements that are capable of creating interference and diffraction to produce arbitrary distributions of light (usually predefined ones). Diffractive
optical element 230 may include a thin micro structure pattern to alter the phase of the light propagated through it. This phase pattern, based on its predesign, can be capable of manipulating the light to almost any desired intensity profile ofstructured light 300. -
Emitter array 210, which includes a plurality ofindividual emitters 212, is operable to emit a plurality of coherent light beams. Eachemitter 212 in the emitter array is operable to emit a light beam, out of the aforementioned plurality of light beams. It is noted that while each of the emitted light beams is coherent within itself, the individual emitters may be implemented such that there is no coherence between the individual emitters. Theindividual emitters 212 ofemitter array 210 may be laser emitters. Especially, eachemitter 212 ofemitter array 210 may be a vertical-cavity surface-emitting laser (VCSEL) emitter. - Optionally, each
emitter 212 of theemitter array 210 is a vertical-cavity surface-emitting laser (VCSEL) emitter, each of which forms its own coherent light beam. Optionally,emitter array 210 is dense with individual emitters of coherent light beams, thereby enabling spatially efficient providing of a high energy structured light pattern. - It is noted that the number of
emitters 212 inemitter array 210 may be selected according to different considerations such as (though not limited to): required light intensity ofsystem 200, geometrical considerations, design of the structured light pattern to be projected bysystem 200, physical consideration (such as heat dissipation), and so on. In but few examples,emitter array 210 may be a 3×3 emitters array (i.e. including nineindividual emitters 212 arrange in three rows of emitters, each include three individual emitters 212), a 10×20 emitters array, a 30×50 emitters array, a 100×100 emitters array, and so on. It is further noted that the design of the array is not necessarily a squared tiled or even rectangular tiled (i.e. emitters are arranged in rows and columns), and many other designs may be used for the arrangement ofemitters 212 within the array. This may include, by way of example, hexagonal tiling, semi-regular tiling, and even irregular tiling. - The light from the various
individual emitters 212 ofemitter array 210 is provided tooptical subunit 220, which is operable to transform the plurality of light beams to provide a plurality of transformed light beams, and to direct the plurality of transformed light beams onto diffractiveoptical element 230. For the readability of the drawings, the light beams as emitted byemitter array 210 are denoted aslight beams 110, and the transformed light beam directed byoptical subunit 220 ontoDOE 230 are denoted 130. Within optical subunit, the light beams are referred to as manipulated light beams 120. It will nevertheless be clear to a person who is of ordinary skill in the art that the different numerals are used for illustrative purposes and that the different light beams numerals refer to the various stages that the beams of light go through within thesystem 200. - Optionally,
system 200 may includeoutput optics 240 through which the transformed light passes before exitingsystem 200 and being projected outside (e.g. onto a scene including one or more objects). Output optics may simply transfer the light as is (e.g. a protective window), but may possibly also further manipulate it (e.g. filter it, or direct it towards an object). -
Optical subunit 220 may transform the light fromemitter array 210 in many ways, in order forsystem 200 to yield the structured light pattern efficiently (i.e. transducing high percentage of the energy consumed by the emitter array to the projected structured light pattern) and with high quality. For example, structured light pattern efficiency can be defined by a certain (e.g. predefined) efficiency threshold, such as a certain percentage (say 80% or above) transducing of the energy consumed by the emitter array to the projected structured light pattern for a given quality threshold, for example, measured as a function of image resolution and/or a level of noise in the projected pattern. Some of the ways in which the light beams 100 are transformed in theoptical subunit 220 are discussed below, with respect to the following figures. It is noted that whileoptical subunit 220 may include only a single element (e.g. a simple lens), in some cases it would include more than one element (e.g. a series of lenses), and therefore theoptical subunit 220 is also occasionally referred to herein asoptical assembly 220. In the example ofFIG. 1 , the path of the light beams withinoptical subunit 220 is an arbitrary illustrative example, and it is noted that different kinds of paths may be used (e.g. folded paths, etc.). - It is noted that
system 200 may be a telecentric system. Optionally,optical subunit 220 may be a telecentric optical subunit, consisting of (or otherwise including) a telecentric compound lens (as is demonstrated for example inFIG. 2 ). In addition to the compound lens, the telecentric optical subunit (if implemented) may include additional optical components, e.g. mirrors for folding the optical path of the light beams inoptical subunit 220. This may be achieved by placing the emitting ends ofindividual emitters 212 at the focal plane of the telecentric optical subunit (and especially in the focal plane of the telecentric compound lens ofoptical subunit 220, if so implemented. This is demonstrated by way of example inFIG. 2 . Optionally, the plurality ofindividual emitters 212 are positioned on the back focal plane of the optical subunit. While not necessarily so, the compound lens which may be included inoptical subunit 220 as described throughout the present disclosure may be implemented as a compound lens which is commonly referred to as a collimator. - It is noted that optical unit 220 (whether including a compound lens or not) may be designed to produce a desired field of view. It may also be corrected for aberrations and distortion.
- As mentioned above, a single DOE element (DOE 230) is used for diffracting a plurality of light beams arriving from different emitters, after these light beams were transformed by
optical subunit 220. Inoptical subunit 220 itself, the same components may be used in order to transform the plurality of light beams 110. That is, optionally,optical subunit 220 may be operable to transform the plurality oflight beams 110 to provide the plurality of transformedlight beams 130 using transforming optical components (e.g. lenses, mirrors, etc.) included inoptical subunit 220, and these transforming optical components may be common to the plurality of light beams. It is noted that not necessarily all of the components ofoptical subunit 220 are used to transform every single one oflight beams 110, and likewise not everylight beam 110 must pass through (or be reflected from) all of the optical components ofoptical subunit 220. - Notably, the dimensions of
system 200 may vary between different implementations of the system. For example, different dimensions of thesystem 200 can be selected according to a utilization for which the system is designated (e.g. overall required illumination pattern size, complexity and intensity, and so on). However, by way of a non-limiting example only, few possible dimensions will be stated. - For example, the distance between
emitter array 210 and DOE 230 (denoted L1) may be in the scale of order of a centimeter (e.g. 5 to 50 millimeters). For example, the diameter of optical subunit 220 (and especially of a compound lens included in optical subunit 220), denoted D1, may be also in the same order of magnitude of about a centimeter (e.g. 1 to 20 millimeters). The focal length of a compound lens ofoptical subunit 220 may be in the same order of magnitude of about a centimeter (e.g. 1 to 20 millimeters). The diameter of eachsingle emitter 212 inemitter array 210 may be in the scale of order of a millimeter (e.g. 0.005-1 millimeter). The field of view (FOV) to whichsystem 200 projects structured light may vary greatly, e.g. between 15° -150°. - The FOV for
system 200 may be designed based on various parameters, e.g. depending on the required application. For example, usingsystem 200 for determining range parameters for automotive applications ((e.g. generating 3D image of object in front of the car) may require a large FOV (e.g. 90°), while medical applications may require a smaller FOV (e.g. 45°). Implementations which rely on dense epipolar separation may require the projected light pattern to have relatively low radial distortion, which dictates a relatively low FOV. - As also demonstrated in
FIG. 2 , optionally,emitter array 210 andoptical subunit 220 are positioned relative to one another such thatoptical subunit 220 transforms the plurality oflight beams 110 by deflecting the plurality oflight beams 110, so that the plurality of transformedlight beams 130 are projected onto diffractiveoptical element 230 at different angles of incidence. According to examples of the presently disclosed subject matter, transforming the light beams 130 such that they are projected onto diffractiveoptical element 230 at different angles of incidence can enable provisioning of a plurality of light patterns by the diffractiveoptical element 230. Each such light pattern can be a result of one or more transformed light beams striking theDOE 230 at a different angle than the transformed light beams which result in other light patterns. - If the transformed
light beams 130 are projected ontoDOE 230 at different angles, the structured light pattern projected bysystem 200 may include the aforementioned plurality of light patterns, as discussed in the previous paragraph. It is noted that the deflection of the plurality oflight beams 110 byoptical subunit 220 may include refracting these light beams once or more, reflecting these light beams once or more, or any other way of deflecting light beams. It is noted that while not necessarily so, each of the transformedlight beams 130 which are deflected byoptical subunit 220 may be projected ontoDOE 230 at totally different angles (i.e. the incidence angle of the chief ray in each of these transformedlight beams 130 would be singular, shared by no other chief ray of another transformed light beam 130). -
FIGS. 3A and 3B are functional block diagrams illustrating an example ofoptical system 200, in accordance with examples of the presently disclosed subject matter. - In
FIG. 3A , light rays of a single light beam 110(1) are traced, from emitter 212(1) ofemitter array 210, throughoptical subunit 220 where it is deflected as manipulated light beam 120(1), to its projection ontoDOE 230 as transformed light beam 130(1) at incidence angle α, where it is diffracted by diffractiveoptical element 230 to provide light pattern 140(1). - In
FIG. 3B , light rays of two light beams are traced. In addition to light rays of light beam 110(1) discussed above, light rays of an additional light beam, light beam 110(2) are also traced. These light rays of light beam 110(2) are traced from emitter 212(2) ofemitter array 210, throughoptical subunit 220 where it is deflected as manipulated light beam 120(2), to its projection ontoDOE 230 as transformed light beam 130(2) at incidence angle β—which is different than the aforementioned angle α—where it is diffracted by the same diffractive optical element,DOE 230, to provide another light pattern 140(2). Clearly, the light rays emitted byother emitters 212 ofemitter array 210 may strike ontoDOE 230 at yet different angles (other than α and β), and are not illustrated in order to simplify the diagram. - As is demonstrated by way of example in
FIG. 3B , the plurality oflight beams 110 emitted byemitter array 210 may propagate to theoptical subunit 220 in parallel (or substantially parallel) paths. Optionally, all of the light beams 110 may propagate to theoptical subunit 220 parallel to a commonoptical axis 10. It is noted that light beams are parallel to each other even if not all of the rays of one of these light beams are exactly parallel to all of the rays of any other of the light beams—as can be seen, this may be difficult if not impossible due to native divergence of the light source. Light beams are considered parallel to each other if the chief rays of these light beams are parallel to each other. It is noted that the light beams emitted by the individual emitters do not have to be parallel to each other. This may be achieved, for example, by a proper design of a VCSEL array source, or a single field lens placed over the array. -
FIG. 4A illustrates an example ofsystem 200 within an environment which includessystem 200 and a projection of structured light (denoted 150), in accordance with examples of the presently disclosed subject matter. In the illustrated example ofFIG. 4A , the light beam emitted by each individual emitter of the 3×2 emitter array of system 200 (not illustrated) results in projection of a singlelight pattern 140, to a total of six such light patterns. Each of the six light patterns is a square bull's-eye pattern (including a black square within a black square frame), and for the sake of illustration, the central top light pattern in the diagram is highlighted. - As can be seen, each of the
light patterns 140 is emitted fromsystem 200 in a different angle, and together the light patterns give rise to a structured light pattern projected bysystem 200, which is a structured light pattern consisting of six square bull's eye targets. Clearly, the shape of each individual pattern in the example ofFIG. 4A is arbitrary, and various different light patterns may be designed, based on a desired structured light pattern to be projected bysystem 200. It is noted that in the illustrated example, thelight patterns 140 resulting from the different emitters are contiguous with each other precisely, but this is not necessary, and differentlight patterns 140 may be designed to partly overlap each other, or be separated from one another and with various gaps in between the patterns. - Since the
same DOE 230 is used for the diffraction of the entire plurality of transformed light beams, optionally the plurality oflight patterns 140 provided by the diffractiveoptical element 230 are copies of a predetermined light pattern (such as the repeated square bull's eye pattern in the example ofFIG. 4A ). It is noted that the copies may be identical copies of each other (similar in pattern and in shape), but may also be spatially distorted copies of the predetermined light pattern. For example,light patterns 140 projected towards the margins of the structuredlight pattern 150 may be elongated with respect tolight patterns 140 projected in the center of structuredlight pattern 150. This possible elongation may be due to any flat plane on which the structured light may be projected (and especially one which is perpendicular to the optical axis) forming different angles with the chief ray of each projectedlight pattern 140. Some kinds of distortion which may occur between the centers of differentlight patterns 140 are distortions types known in the art as “Barrel distortion” (in which image magnification decreases with distance from the optical axis), “Pincushion distortion” (in which image magnification increases with the distance from the optical axis) and “mustache distortion” (which behaves as barrel distortion close to the image center, and gradually turns into pincushion distortion towards the image periphery) or distortions similar thereto. Intensity distortions between the center and the sides of the structured light pattern may also potentially occur in some situations. Some ways in which distortion may be reduced insystem 200 are discussed with respect toFIGS. 12A through 12G . - However, in all of these examples, the basic shape of the predetermined light pattern will be kept in all of its copies (e.g. the bull's eye pattern) and for this particular example the shape of the bull's eye pattern will change from being square to a parallelogram. This can be designed to still be recognizable by an interpreter of the structured light pattern (
e.g. processing unit 260 discussed below). Like the arrangement ofemitters 212 inemitters array 210, the tiling between the copies of the predetermined light pattern (if implemented) is not necessarily a squared tiled or even rectangular tiled (i.e. light pattern copies are arranged in rows and columns), and many other types and shapes of tiling may be used such as, by way of example, hexagonal tiling, semi-regular tiling, and even irregular tiling (i.e. tiling without a repeated pattern). - As mentioned above, optionally the copies of the predetermined light pattern (if implemented) are adjacent to each other (e.g. each copy of the predetermined light pattern may optionally be adjacent to one, or two, or three, etc. other copies of the predetermined light pattern). This may be used for tiling an area whose size is much larger (e.g. at least 50 times larger) than a size of any of the projected copies of the predetermined light pattern. This way, using a relatively simple diffractive optical element as DOE 230 (which is cheaper to design and to manufacture) which is designed to diffract an incident coherent light beam to provide a relatively simple light pattern—to generate much larger and more complex or intricate structured light pattern, e.g. as demonstrated (in small scale, only 6 times larger) in
FIG. 4A . - Even more so, in the example of
system 200 proposed above, a single diffractive optical element (DOE 230) is used for generating the plurality of copies of the predetermined light pattern, thereby facilitating projection of a high contrast and high clarity overall output pattern of the optical system. In other words, the configuration of system 200 (e.g. utilization of a single diffractive optical element the generating of the plurality of copies of the predetermined light pattern) facilitates projection of a high contrast and high clarity overall output pattern of the optical system. -
FIG. 4B illustrates an example ofsystem 200 within an environment which includessystem 200 and a projection of structured light (denoted 150), in accordance with examples of the presently disclosed subject matter. In the illustrated example ofFIG. 4B , the light beam emitted by each individual emitter of the emitter array of system 200 (not illustrated, including five emitters) results in projection of a singlelight pattern 140, to a total of five such light patterns. Like inFIG. 4A , each of the five light patterns is a square bull's-eye pattern (including a black square within a black square frame). The edges of each of thepatterns 140 are marked by a dashed line. As can be seen, each of thepatterns 140 partly overlaps at least oneother pattern 140. - Optionally,
system 200 may be designed so that each provided copy of the predetermined light pattern partly overlaps at least one other provided copy of the predetermined light pattern. The percent of the overlap between two patterns may vary, but it may very well exceed 25% (and possibly significantly more). Overlapping between such patterns may be used for reducing speckle noise, as discussed, for example, with respect toFIG. 4C . -
FIG. 4C is an exploded view of an example of the projection of system 200 (not shown), including projection of structured light denoted 150 made of a plurality of partially overlappinglight patterns 140, in accordance with examples of the presently disclosed subject matter. In the illustrated example ofFIG. 4C , the light beam emitted by each individual emitter of the emitter array of system 200 (not illustrated, including three emitters) results in projection of a single light pattern 140(1), to a total of three such light patterns. In the case ofFIG. 4C , each of the three light patterns 140(1) includes four square bull's-eye patterns. - As is demonstrated in the example of
FIG. 4C , optionally, the predetermined light pattern (of which the light patterns 140(1) are copies) including multiple copies of a repeated subpattern (in this case—four copies of a repeated bull's eye pattern), wherein in each provided copy 140(1) of the predetermined light pattern, at least one subpattern (i.e. bull's eye pattern in the example) overlaps a subpattern of at least one other provided copy 140(1) of the predetermined light pattern which is generated by light originating from another light emitter. For example, the highlighted subpattern in structured light pattern 150 (denoted 140′) is illuminated by subpatterns included in all of the three light patterns 140(11), 140(12) and 140(13) ofFIG. 4C (the respective subpatterns are highlighted). - Therefore, the overall intensity in which this subpattern is illuminated arrives from three different
individual emitters 212. Optionally, theindividual emitters 212 ofemitter array 210 are uncorrelated to each other at least in some respects, meaning that while possibly emitting in similar emission spectrum/wavelength, the phases of the different individual emitter are independent of each other. It is noted that such relation of uncorrelation may exist between any pair ofemitters 212 inemitter array 210, and may also be limited (if implemented) to subgroups ofemitters 212 withinemitter array 210. Therefore, the overall intensity in which a subpattern is illuminated may arrive from a plurality of differentindividual emitters 212 whose phase is independent of each other. Since the illumination arrives from different sources whose phase is independent of each other, the speckle noise may be reduced in comparison to the speckle noise that would have been present in case the same subpattern had been illuminated with the same intensity by a single coherent source (such as a laser emitter). - The degree of overlapping between light patterns may be predesigned according to various criteria. Such criteria may be, for example, the amount of speckle noise desired to be reduced (the more overlapping the better), and on the other had the allowed minimal distance between the emitters (permitted by considerations such as heat dissipation and/or coherency independency).
-
FIG. 5 is a functional block diagram illustrating an example ofoptical system 200, in accordance with examples of the presently disclosed subject matter. InFIG. 5 there is presented a possible utilization of the projection of the structuredlight pattern 150 insystem 200. It is noted that these possible uses are offered by way of a non-limiting example, as many other uses will present themselves to a person who is of skill in the art. Furthermore, while the functionalities of utilizing the projection ofsystem 200 are discussed as being implemented by components of thesame system 200, it will be clear that such functionalities may also be implemented by an external system and with additional, fewer or other components for utilizing the projection. - As exemplified in
FIG. 4B , while not necessarily sosystem 200 may include projection optics (such as output optics 240) operable to image at least a part of the structured light pattern onto anobject 400.System 200 may further include one ormore imaging sensors 250 which are adapted to capture an image ofobject 400 with the structuredlight pattern 150 projected thereon. It is noted that the captured image may include only the light of structuredlight pattern 150 reflected from object 400 (denoted 310, e.g. if using illumination spectrum not found in the ambient lighting of object 150), but may also image additional light on top of the patterned light (such as ambient light reflecting fromobject 400, or light emitted by object 400). For example, the image of theobject 400 can be an IR image. -
System 200 in such an implementation may further include processingunit 260 which is adapted to process the image (or a plurality of images, e.g. video; possibly with the addition of other data used in the processing) in order to determine parameters forobject 400. Especially, processingunit 260 may be configured and operable to process image data generated by the one ormore imaging sensors 250 for determining range parameters forobject 400, such as a depth values (e.g. distance from the camera 250) for different parts of the imagedobject 400. - Different techniques may be used for analyzing patterned image of an object in order to determine range parameters for the objects. Several such techniques are discussed in U.S. Pat. Nos. 8,090,194, 8,208,719, 8,538,166, and International Publication No. WO2008/062407 assigned to the same assignee, all of which are incorporated herein by reference in their entirety.
- Optionally, processing
unit 260 may be configured and operable to provide to an external system information which is based on the range parameters determined by it (including the range parameters themselves and/or information which is selected and/or generated based on the range parameters). This may be facilitated by an optional hardware and/orsoftware interface 270 which is illustrated inFIG. 5 . -
FIG. 6 is a functional block diagram illustrating an example ofoptical system 200, in accordance with examples of the presently disclosed subject matter. As discussed above, optionally theoptical subunit 220 may include a plurality of optical elements having a common optical axis common to the plurality of optical elements (denotedoptical axis 10 inFIGS. 3A and 3B ). As demonstrated inFIG. 6 , optionally the commonoptical axis 10 is folded at least once. - It is noted that optionally (e.g. as demonstrated in
FIG. 6 ), the transformedlight beams 130 which reach theDOE 230 may at least partially overlap with each other (i.e., with one or two or three, etc. other light beams) at the DOE plane. -
FIG. 7 illustrates an example ofoptical system 200 within an environment which includessystem 200 and anobject 400′ in accordance with examples of the presently disclosed subject matter. For example, object 400′ may be an object for which various parameters—e.g. range parameters—are to be determined bysystem 200. - As aforementioned,
system 200 may be designed so that light beams which are emitted fromdifferent emitters 212 of theemitter array 210 result in projection of light pattern in different angles. As demonstrated inFIG. 3B , optionally the angle in which such light pattern resulting from asingle emitter 212 is projected—depends on the position of thisemitter 212 with respect tooptical subunit 220. Such a configuration enablessystem 200 to project two or more different projections of the structured light pattern, which are shifted with respect to one another. Especially, such a configuration enablessystem 200 to project two different projections of the structured light pattern, which are rigidly translated with respect to one another. - In the example illustrated in
FIG. 7 ,system 200 includes an emitter array control system (not illustrated) which is configured and operable to control activation of different subgroups ofemitters 212 ofemitter array 210, thereby resulting in providing of offset overall output patterns of the optical system at different times. - For example, the
individual emitters 212 ofemitter array 210 may be arranged in alternating rows (each subgroup including either odd or even rows) of a hexagonallytiled emitter array 210. In hexagonal tiling, each row is shifted with respect to the rows above and below it, and therefore for eachemitter 212 in a given row, theadjacent emitters 212 in the adjacent rows of emitters are located diagonally with respect thereto.FIG. 11 illustrates a hexagonal configuration of emitter array in accordance with examples of the presently disclosed subject matter. - The result of such a configuration are exemplified in
FIG. 7 . such an alternating activation of different subgroups ofemitters 212 may enablesystem 200 to project onto anobject 400′ (and onto a background scene which includes in this example a wall denoted 499) a first projection of the structured light pattern (denoted “First projection 11” in diagram 7.1 ofFIG. 7 ) and a second projection of the structured light pattern (denoted “Second projection 22” in diagram 7.2 ofFIG. 7 ). The light pattern created by the light of eachlight beam 110 is denotedlight pattern 140 in the two diagrams ofFIG. 7 . -
First projection 11 andsecond projection 22 of the structuredlight pattern 150 may be projected onto the scene in different times (for example, diagram 3A illustrates the environment in time T1, and diagram 3B illustrates the environment in time T2 which is later than T1).First projection 11 andsecond projection 22 of the structuredlight pattern 150 may be projected onto the scene at least partly concurrently, e.g. in a configuration in which theemitters 212 of different subgroups emits light in different wavelengths. - As can be seen, the
first projection 11 and thesecond projection 22 of the structured light pattern (which in this case is a coded light pattern which includes alternating zoomorphic graphemes) are rigidly shifted with respect to one another. As is also demonstrated inFIG. 7 , the structured light pattern may appear on different scale, depending on the distance of a lighted object fromsystem 200, and one object may cast a shadow on another object, thereby hiding a part (or the entirety) of another object fromsystem 200 from a given perspective. - In the following figures, examples of variations of some of the ways in which
optical subunit 220 may transform the light ofemitter array 210, and some of the benefits of such configurations, are discussed in greater detail. -
FIG. 8 is a functional block diagram illustrating an example ofoptical system 201 in accordance with examples of the presently disclosed subject matter. It is noted thatsystem 201 may be implemented with any of the variations ofsystem 200 discussed above. It is however noted thatsystem 201 may incorporate any of the features, components and abilities discussed above with respect tosystem 200 as general. Furthermore,system 201 may incorporate any of the features, components and abilities discussed below with respect tosystems system 201 are denoted using the same numeral reference used for the components ofsystem 200, and the variations discussed with respect to these components in other parts of the document may also pertain, mutatis mutandis, tosystem 201. - In
system 201,emitter array 210 includes a plurality ofindividual emitters 212. Eachemitter 212 in theemitter array 210 ofsystem 201 is operable to emit alight beam 110 which is characterized by anative beam width 10.Optical subunit 220 ofsystem 201 is operable to transform a plurality oflight beams 110 emitted by theemitter array 210, wherein each of the transformedlight beams 130 is characterized by an expandedbeam width 30 that is wider than thenative beam width 10 of the correspondinglight beam 110, and which is wider than a facilitating beam width.DOE 230 insystem 201 is capable of diffracting the transformed light beams so as to provide light patterns whose angular resolution meets a light pattern target angular resolution criteria. -
System 201 is an optical system which includes a diffractive optical element (DOE 230), capable of diffracting an incident coherent light beam to provide a light pattern. It is noted that while not necessarily so, the resolution of the light pattern provided by theDOE 230 has a positive correlation with a width of the incident light beam. That is, the wider the incident light beam, the finer resolution that the DOE would be able to produce. - A facilitating beam width is hereby defined for
DOE 230, so that incidence uponDOE 230 of coherent light beams that are wider than the facilitating beam width would result in provision of light patterns whose angular resolution meets a light pattern target angular resolution criteria. - For example, for many practical DOE's the beam width should cover at least 4 periods of the grating structure. So, for example, if we require an inter beam resolution of 6 mRad at a wavelength of 850 nm, the grating period d will be given by d sin θ=λ, where θ=6 mRad, λ=850 nm. From this d=0.14 mm. Therefore to achieve this angular resolution of 6 mRad the beam width at the DOE has to be at least 4×d=0.57 mm
- Light emitters which emit coherent light beams that are wider than the facilitating beam width may be created. However, the physical size of such emitters, the heat which they produce or the possibility to pack a large number of such light sources into a compact packaging may render utilization of such light emitters impractical for
system 201. Therefore, utilization of emitters which emit narrower light beams is investigated below with respect tosystem 201. -
System 201 further includesemitter array 210 which includes a plurality of individual emitters.Emitter array 210 ofsystem 201 is operable to emit a plurality of coherent light beams. Eachemitter 212 inemitter array 210 ofsystem 201 is operable to emit a light beam 110 (out of the plurality of light beams 110), which is characterized by a native beam width. For the sake of clarity of illustration, only twolight beams 110 are illustrated inFIG. 8 . - The beam diameter or beam width of an electromagnetic beam is the diameter along any specified line that is perpendicular to the beam axis and intersects it. Since beams typically do not have sharp edges, the diameter can be defined in many different ways. Some definitions of beam width which are well accepted in the art include D4σ, 10/90 (or 20/80) knife-edge, 1/e2, FWHM, and D86. It is noted that the native beam width of a
light beam 110 emitted by anemitter 212 may be measured at any point between therespective emitter 212 and the point in which thatlight beam 110 meets the first optical component of optical subunit 220 (e.g. a lens, a mirror, etc.). Such native beam widths are denoted asnative widths 20 inFIG. 8 . -
Optical subunit 220 in system 201 (which may be an optical assembly which includes a plurality of optical elements) is operable to transform the plurality oflight beams 110 to provide a plurality of transformedlight beams 130, and to direct the plurality of transformedlight beams 130 onto the diffractiveoptical element 230, resulting in providing of a structured light pattern 150 (not illustrated) byoptical system 201. - In
system 201, each of the transformedlight beams 130 is characterized by an expanded beam width (denoted 30) that is wider than thenative beam width 20 of the correspondinglight beam 110. Furthermore, the expandedbeam widths 30 of the plurality of transformedlight beams 130 are larger than the facilitating beam width. - The expansion of
light beams 110 may enable utilizing light sources whose native beam width is below the aforementioned facilitating beam width of DOE 230 (e.g. which in turn may enable, for example, using emitters of smaller dimensions, using emitters which produce relatively less heat, pack a large number emitters into a tight volume, and so on). - Optionally, each
emitter 212 inemitter array 210 is operable to emit a light beam whose native beam width is narrower than the facilitating beam width. Optionally, eachemitter 212 inemitter array 210 is operable to emit a light beam whose native beam width is narrower than the facilitating beam width by a factor of at least 2. Optionally, eachemitter 212 inemitter array 210 is operable to emit a light beam whose native beam width is narrower than the facilitating beam width by a factor of at least 5. - Optionally, each
emitter 212 inemitter array 210 is operable to emit a light beam whose native beam width is narrower than the facilitating beam width by at least one order of magnitude. - For example, the
native beam widths 20 oflight beams 110 insystem 201 may be 10-100 micrometer, while the expandedbeam widths 30 of the corresponding transformedlight beams 130 may be 100-1000 micrometer. Optionally, the expandedbeam widths 30 of transformedlight beams 130 insystem 201 may be at least 3 times larger than the correspondingnative beam widths 20 of the corresponding light beams 110. - An example of utilization for the expansion of beams for the miniaturization of
system 201 is the ability to pack theemitters 212. For example, optionally for eachindividual emitter 212 ofemitter array 210 there is at least one otherindividual emitter 212 of theemitter array 210 positioned at a distance which is at least 10 times smaller than any beam-width 30 of any transformedlight beam 130 out of the plurality of transformed light beams 130. - As discussed with respect to
system 200, optionallyoptical subunit 220 ofsystem 201 is an optical assembly which includes a plurality of optical elements. Furthermore, this plurality of optical element may have a common optical axis common to the plurality of optical elements. - As discussed above (e.g. with respect to
FIGS. 3A and 3B ),emitter array 210 andoptical subunit 220 may be positioned relative to one another such thatoptical subunit 220 further transforms the plurality of light beams (in addition to expanding the width of the beams) by deflecting the plurality oflight beams 110, so that the plurality of transformedlight beams 130 are projected onto diffractiveoptical element 230 at different angles of incidence, resulting in providing of a plurality oflight patterns 140 by diffractive optical element 230 (where the structuredlight pattern 150 includes these plurality of light patterns 140). - It is noted that in addition to expanding the width of the light beams 110,
optical subunit 220 may transform the light beams 110 in additional ways, which would contribute to the efficiency and quality of the projection ofsystem 201 even more. For example,optical subunit 220 may further transform the light beams 110 in order to reduce their divergence (collimating the beams). - Each
emitter 212 in theemitter array 210 is operable to emit a light beam 110 (out of the plurality of light beams 110) which is characterized by a divergence (referred to below as the first beam divergence of thelight beam 110 of this emitter 212). Optionally,optical subunit 220 ofsystem 201 is further operable to transform the plurality oflight beams 110, so that each of the transformedlight beams 130 is characterized by a second beam divergence that is smaller than the first beam divergence of the correspondinglight beam 110. The reduction of the divergence of the light beams 110 is further investigated with respect tosystem 202. -
FIG. 9 is a functional block diagram illustrating an example ofoptical system 202 in accordance with examples of the presently disclosed subject matter. It is noted that in further examples,system 202 may be implemented with any of the variations ofsystem 200 discussed above. It is however noted thatsystem 202 may incorporate any of the features, components and abilities discussed above with respect tosystem 200 as general. Furthermore,system 202 may incorporate any of the features, components and abilities discussed below with respect tosystems system 202 are denoted using the same numeral reference used for the components ofsystem 200, and the variations discussed with respect to these components in other parts of the document may also pertain, mutatis mutandis, tosystem 202. -
System 202 is an optical system which includes a diffractive optical element (DOE 230), capable of diffracting an incident coherent light beam to provide a light pattern. It is noted that while not necessarily so, the contrast of the light pattern provided by theDOE 230 has a negative correlation with the divergence of the incident light beam. That is, the lesser the divergence of the incident light beam, the better contrast will the DOE be able to produce. - Light emitters which emit coherent light beams and whose emitted light coherent light beams are characterized by relatively low divergence can be created. However, the physical size of such emitters, the heat they produce or the possibility to pack a large number of such light sources into a compact packing may render utilization of such light emitters impractical for
system 202. Therefore, utilization of emitters which emit light beams with divergence that is larger than the divergence of the light beams which ultimately reaches the DOE is investigated below with respect tosystem 202. -
System 202 is an optical system, which includes at least diffractive optical element 230 (capable of diffracting an incident coherent light beam to provide light pattern 150),emitter array 210 which includes a plurality ofindividual emitters 212, andoptical subunit 230. - As aforementioned, each
emitter 212 inemitter array 210 is operable to emit alight beam 110, out of the plurality oflight beams 110, which is characterized by a first beam divergence. Such first beam divergence is denotedfirst beam divergence 40 inFIG. 9 . - In
system 202,emitter array 210 includes a plurality ofindividual emitters 212. Eachemitter 212 inemitter array 210 is operable to emit alight beam 110 which is characterized by a first beam divergence.Optical subunit 220 insystem 202 is operable to transform a plurality oflight beams 110 emitted byemitter array 210, wherein each of the transformedlight beams 130 is characterized by a second beam divergence that is smaller than the first beam divergence of the correspondinglight beam 110.DOE 230 is capable of diffracting the transformed light beams to provide light patterns. -
Optical subunit 220 is operable to transform the plurality oflight beams 110 to provide a plurality of transformedlight beams 130 and to direct the plurality of transformedlight beams 130 onto diffractiveoptical element 230, to thereby provide structuredlight pattern 150 byoptical system 202. Each of these transformedlight beams 130 provided byoptical subunit 220 ofsystem 202 is characterized by a second beam divergence (denoted 50 inFIG. 9 ) that is smaller than thefirst beam divergence 40 of the correspondinglight beam 110. - Optionally, a facilitating beam divergence (θmax) is defined for
DOE 230 so that incidence upon theDOE 230 of coherent light beams whose divergence is lower than the facilitating beam divergence (θbeam<θmax) results in provisioning of light patterns whose contrast meets a light pattern target contrast criteria. In such case,system 202 may be designed so that thesecond beam divergences 50 of the plurality of transformedlight beams 130 insystem 202 are lower than the facilitating beam divergence (θmax). The light beams have to be wider than the facilitating beam width. - Therefore, transforming the light beams 110 by the
optical subunit 220 ofsystem 202 enables to achieve better contrast compared to a design that does not include theoptical unit 220. Also, by transforming the light beams 110, it is possible to utilizeemitters 210 which are capable of emittinglight beams 110 that are characterized by larger divergence than would otherwise be required, and still receive a structured light pattern with high contrast. Furthermore, it is noted that emitters with narrow light beams (whose use for miniaturization etc. is discussed with respect tosystem 201 above) can also have larger divergence than is possible to achieve with emitters that produce wider light beams. Therefore, reducing the divergence oflight beams 110 byoptical subunit 220 enables utilizing emitters with divergence that is larger than the facilitating beam divergence, and also emitters which emit narrow light beams. - Optionally, each
emitter 212 inemitter array 210 is operable to emit alight beam 110 whosefirst beam divergence 40 is larger than the facilitating beam divergence (θmax) by at least one order of magnitude. - Optionally, each
emitter 212 inemitter array 210 is operable to emit alight beam 110 whosenative beam width 20 is narrower than the facilitating beam width by at least one order of magnitude, and whosefirst beam divergence 40 is larger than the facilitating beam divergence (θmax) by at least one order of magnitude. - Optionally,
optical subunit 220 may be operable to reduce a divergence of eachlight beam 110 out of the plurality the light beams 110 by at least 90% to provide the respective transformedlight beam 130. - For example, the first beam divergences of the
light beams 110 emitted by emitter array may be 100 mrad-500 mrad, while the second beam divergences of the corresponding light beams may be 5 mrad-50 mrad. - As aforementioned, optionally
optical subunit 220 is operable to transform the plurality oflight beams 110 to provide the plurality of transformedlight beams 130 using transforming optical components of theoptical subunit 220 which are common to the plurality of light beams 110. - As also discussed above, optionally emitter
array 210 andoptical subunit 220 are positioned relative to one another such thatoptical subunit 220 further transform the plurality oflight beams 110 by deflecting the plurality oflight beams 110 to thereby cause the plurality of transformedlight beams 130 to be projected onto diffractiveoptical element 230 at different angles of incidence, resulting in providing of a plurality oflight patterns 140 by the diffractive optical element. - As aforementioned, packing many individual emitters in a small emitter array may improve the quality of the structured
light pattern 150 projected bysystem 200 in many ways, such as improving its angular resolution, its speckle noise, etc. It may also contribute to the miniaturization ofsystem 200, to lowering the system's 200 energy consumption, etc. -
FIG. 10 is a functional block diagram illustrating an example ofoptical system 203 in accordance with examples of the presently disclosed subject matter. It is noted thatsystem 203 may be implemented with any of the variations ofsystem 200 discussed above. It is however noted thatsystem 203 may incorporate any of the features, components and abilities discussed above with respect tosystem 200 as general. Furthermore,system 203 may incorporate any of the features, components and abilities discussed below with respect tosystems system 203 are denoted using the same numeral reference used for the components ofsystem 200, and the variations discussed with respect to these components in other part of the document may also pertain, mutatis mutandis, tosystem 203. -
System 203 includes at least (a) diffractiveoptical element 230 which is capable of diffracting an incident coherent light beam to provide a light pattern, (b)emitter array 210 which includes a plurality of individual emitters 212 (theemitter array 210 is operable to emit a plurality of coherent light beams), and (c)optical subunit 220. - In
system 203,emitter array 210 includes a plurality ofindividual emitters 212. Eachemitter 212 in theemitter array 210 is operable to emit alight beam 110.Optical subunit 220 insystem 203 is operable to: a. transform a plurality oflight beams 110 emitted by theemitter array 210, wherein the transformation includes expansion and/or collimation of the plurality oflight beams 110; and b. direct the plurality of transformed light beams onto the diffractive optical element at different angles of incidence, resulting in providing of a plurality of light patterns by the diffractive optical element. -
DOE 230 insystem 203 is capable of diffracting the transformed light beams to provide light patterns; - Furthermore, in
emitter array 210 ofsystem 203, for eachindividual emitter 212 there is at least one otherindividual emitter 212 ofemitter array 210 which is positioned at a distance which is smaller than anybeam width 30 of any transformedlight beam 130 out of the plurality of transformed light beams 130. The distance between any two emitters is denoted 60 inFIG. 10 . - As discussed above with respect to
system 200, optionallyoptical subunit 220 is operable to transform the plurality oflight beams 110 to provide the plurality of transformedlight beams 130 using transforming optical components ofoptical subunit 220 which are common to the plurality of light beams 110. -
FIGS. 12A through 12G include diagrams which are related to possible distortions in the light patterns generated bysystem 200, and ways to reduce such distortion, in accordance with examples of the presently disclosed subject matter. It is noted that distortion and other problems may occur throughout the generated light pattern, and especially at the edge of the field of projection of the light pattern. In the discussion pertaining toFIGS. 12A through 12G it is assumed that thelight pattern 150 includes a plurality of points, and that structuredlight pattern 150 is constructed from a plurality of light patterns 140 (as discussed above, e.g. with respect toFIGS. 4A, 4B and 4C . The exemplarylight pattern 140 used in the examples ofFIGS. 12A through 12G is designed to include a plurality of regularly spaced points, as exemplified inFIG. 12A . In the following discussion pertaining toFIGS. 12A through 12G ,light pattern 140 is also referred to as “tile pattern”. - In the present example, the
tile pattern 140 at the center of the field will form a nearly rectangular shape containing regularly spaced points, whereas at the edge of the field the points of each tile pattern will form a nearly parallelogram shape, as exemplified inFIG. 12B . The reason for this distortion of the tile pattern is that for different light beams emitted bydifferent emitters 212 ofemitter array 210, the distance of the chief ray of the light beams from the DOE to the object plane is very different for tile patterns located in different field points. It is noted that the distortion assumes a non-spherical plane on which the structuredlight pattern 150 is projected. If the object plane was spherical then the distance fromDOE 230 to the object on which the light pattern is projected would have been the same. - In the example of
FIGS. 12A through 12G , the tile pattern includes forty nine points formed by diffraction throughDOE 230. The tile pattern ofFIG. 14A is formed using a light beam whose chief ray angle (CRA) is zero. The source light beam in the example ofFIG. 14A is a simple laser beam parallel to the optical axis. The source light beam in the example ofFIG. 12B is a simple laser beam which propagates towards the DOE diagonally to the optical axis. -
FIG. 12C illustrates a simplified configuration ofsystem 200 which was used to generate the light patterns inFIGS. 12E and 12G . For simplicity of illustration, only 18individual emitters 212 and their respective light beams are illustrated in the following examples. As seen inFIG. 12D , out of these 18emitters 212, 9emitters 212 are centered about the lens (i.e. are close to the optical axis) and 9emitters 212 are at the edge of the field (remotely from the optical axis). As the light beam emitted by each emitter 212 passes through the DOE 230 (after being transformed by optical subunit 220), it produces its own tile pattern of 49 points.FIG. 12E illustrates the projection of the tile patterns generated by theemitters 212 ofFIG. 12D on a projection plane that is perpendicular to the optical axis. - As can be seen in
FIG. 12E , the ninetile patterns 140 which are located near the edge of the field are not rectangular (shaped more like a parallelogram than a rectangle), and the separation between the individual points of each tile pattern is larger than the separation between the points in the ninecentral tile patterns 140. Furthermore, in all of the field, thetile patterns 140 are not adjacent to each other, creating a discontinuity in the structured light pattern. - As aforementioned, the
individual emitters 212 ofemitter array 210 may be arranged in a non-regular (or semi-regular) configuration. The configuration ofFIG. 12F may be used to correct a discontinuity which results in the example ofFIGS. 12D and 12E from the regular distribution of theemitters 212 inemitter array 210. - As can be seen, the distance between the nine
central emitters 212 was reduced, and is significantly smaller than the separation between the nineremote emitters 212, near the sides ofemitter array 210. Furthermore, the nineremote emitters 212 are not arranged in a rectangular configuration. These nineremote emitters 212 may be arranged on a distorted grid (e.g. a regular XY grid to which pincushion distortion was applied). -
FIG. 12G illustrates structuredlight pattern 150 which results from the emitters configuration ofFIG. 12F . As can be seen, thelight patterns 140 in each of the clusters (the central cluster of nine tile patterns and the remote cluster of nine tile patterns) are adjacent to each other, without discontinuities. - Generally with respect to
system 200, it is noted that the positioning of theindividual emitters 212 withinemitter array 210 may be selected to reduce discontinuity between thelight patterns 140 resulting fromdifferent emitters 212. Optionally theindividual emitters 212 ofemitter array 210 are arranged on a radially distorted regular grid (i.e. on a regular grid on which radial distortion transformation was applied). Different regular grids may be radially distorted for overcoming discontinuity—e.g. rectangular grid, hexagonal grid, and so on. - It is further noted that processing unit 260 (if implemented) may include algorithms which compensate for such distortion and/or discontinuity of the structured light pattern. It is noted that the arrangement of the
individual emitters 212 may depend not only on the distortion of the collimator lens, but also on the distortion of the object space field of view (if known in advance). Notably, for 3D imaging the object space field is usually not known in advance (with the exception of calibration scenes, etc.). Theemitter array 210 may be tailored for a particular optics ofoptical unit 220, any change in the optics would require different emitter array spacing configuration in order to reduce the distortion and the discontinuity. -
FIG. 13 is a functional block diagram illustrating an example ofoptical system 204 in accordance with examples of the presently disclosed subject matter. Diagram 13.1 illustratessystem 204 in a diagonal view, and diagram 13.2 illustratessystem 204 in a side view. It is noted thatsystem 204 may be implemented with any of the variations ofsystem 200 discussed above. It is however noted thatsystem 204 may incorporate any of the features, components and abilities discussed above with respect tosystem 200 as general. Furthermore,system 204 may incorporate any of the features, components and abilities discussed below with respect tosystems system 204 are denoted using the same numeral reference used for the components ofsystem 200, and the variations discussed with respect to these components in other part of the document may also pertain, mutatis mutandis, tosystem 204. -
System 204 includes at least (a) diffractiveoptical element 230 which is capable of diffracting an incident coherent light beam to provide a light pattern, (b)emitter array 210 which includes a plurality of individual emitters 212 (theemitter array 210 is operable to emit a plurality of coherent light beams), and (c)optical subunit 220. - In
system 204, the plurality ofindividual emitters 212 ofemitter array 210 are arranged so as to form a planar emission plane (denoted 111), wherein each emitter in the emitter array is operable to emit a light beam. -
Emission plane 111 is a plane in which the emitting ends ofindividual emitters 212 are located (as illustrated in both of diagrams 13.1 and 13.2).Emission plane 111 is planar in the sense that all of the emitting ends ofindividual emitters 212 are located on a flat plane. - It is noted that an emitter array whose emitters are arranged on a planar emission plane is usually simpler and cheaper to produce than an emitter array whose emitters are arranged on a non-flat emission plane. Furthermore, designing an emitter array characterized by a planar emission plane is simpler and cheaper than designing an emitter array with a non-flat emission plane.
- The present disclosure teaches how to use an
optical subunit 220 so as to enable using an emitter array with a planer emission plane while overcoming various optical issues. Further discussion is presented above, e.g. with respect toFIGS. 12A through 12G . -
Optical subunit 220 insystem 204 is operable to: (a) transform a plurality of light beams emitted by the emitter array, wherein the transformation includes expansion and/or collimation of the plurality of light beams; and (b) to direct the plurality of transformed light beams onto the diffractive optical element at different angles of incidence, resulting in providing of a plurality of light patterns by the diffractive optical element.DOE 230 ofsystem 204 is capable of diffracting the transformed light beams to provide light patterns. - As discussed with respect to
system 200, optionallyoptical subunit 220 includes a plurality of optical elements having a common optical axis common to the plurality of optical elements. - As discussed with respect to
system 200, optionallyoptical subunit 220 is operable to transform the plurality oflight beams 110 to provide the plurality of transformedlight beams 130 using transforming optical components, out of the plurality of optical components, which are common to the plurality of light beams. - As discussed with respect to
system 200, optionally emitterarray 210 andoptical subunit 220 are positioned relative to one another such thatoptical subunit 220 further transform the plurality oflight beams 110 by deflecting the plurality oflight beams 110 so that the plurality of transformedlight beams 130 are projected ontoDOE 230 at different angles of incidence, resulting in providing of a plurality of light patterns byDOE 230. -
FIG. 14 is a functional block diagram illustrating an example ofoptical system 205 in accordance with examples of the presently disclosed subject matter. It is noted thatsystem 205 may be implemented with any of the variations ofsystem 200 discussed above. It is however noted thatsystem 204 may incorporate any of the features, components and abilities discussed above with respect tosystem 200 as general. Furthermore,system 205 may incorporate any of the features, components and abilities discussed below with respect tosystems system 205 are denoted using the same numeral reference used for the components ofsystem 200, and the variations discussed with respect to these components in other part of the document may also pertain, mutatis mutandis, tosystem 204. -
System 205 includes at least (a) diffractiveoptical element 230 which is capable of diffracting an incident coherent light beam to provide a light pattern, (b)emitter array 210 which includes a plurality of individual emitters 212 (theemitter array 210 is operable to emit a plurality of coherent light beams), and (c)optical subunit 220. - In
system 205, the combination ofoptical subunit 220 andDOE 230 is characterized by a distortion function. The plurality ofindividual emitters 212 insystem 205 are arranged in a non-uniform configuration whose relation to a predefined uniform grid is an inverse function of the distortion function. It is noted that in different systems, the relative amount of distortion caused by theoptical subunit 220 and theDOE 230 may vary, and optionally all of the distortion may be caused byDOE 230, without additional distortion caused byoptical subunit 230. In such case, the distortion function may characterize theDOE 230. - An example of the distortion function of
optical subunit 220 is presented inFIGS. 12D and 12E . As can be seen, a regular grid ofindividual emitters 212 inFIG. 12D is transformed into a non-regular array of illumination.Method 900 inFIG. 25 discloses a method which may be used to determine the distortion function, and based on which to determine a non-uniformed configuration which may be used for the individual emitters ofsystem 205. - As discussed with respect to
system 200,optical subunit 220 ofsystem 205 may be operable to direct the plurality of transformed light beams onto the diffractiveoptical element 230 at different angles of incidence, resulting in providing of a plurality of light patterns by diffractiveoptical element 230. -
FIG. 15 is a functional block diagram illustrating an example ofoptical system 200, in accordance with examples of the presently disclosed subject matter. InFIG. 15 there is presented a possible utilization of the projection of the structuredlight pattern 150 insystem 200, for capturing three dimensional (3D) images. The capturing of 3D images bysystem 200 is facilitated by determining range parameters for objects imaged in different pixels of the image. It is noted that these possible uses are offered by way of a non-limiting example, as many other uses will present themselves to a person who is of skill in the art. Furthermore, while the functionalities of utilizing the projection ofsystem 200 are discussed as being implemented by components of thesame system 200, it will be clear that such functionalities may also be implemented by an external system and with additional, fewer or other components for utilizing the projection. - The following discussion relates to a system for managing 3D capture. It will be clear to a person who is of skill in the art that the following discussion is also applicable to methods and computer program products for managing 3D capture, mutatis mutandis, and that the latter are not discussed in detail for reasons of brevity.
- According to examples of the presently disclosed subject matter, managing the 3D capture can include managing use of resources in a mobile computing device, more particularly, a mobile communication device such as a smartphone, a tablet and/or their likes according to predefined rules or criteria. In further examples of the presently disclosed subject matter, managing the 3D capture can include managing use of one or more 3D capturing resources in a mobile communication device. Yet further by way of example, managing the 3D capture can include managing one or more of: power consumption, a memory and/or storage utilization, allocation communication bandwidth consumption, allocation of processing resources (e.g., CPU cycles) etc. In the following description, by way of non-limiting example for a mobile computing device, reference is typically made to a mobile communication device.
- Throughout the following description, reference is made to the term “3D capture”. The
term 3D capture relates to a technological process which involves utilizing a plurality of resources of a mobile communication device to obtain depth or range data (3D data) with respect to a certain scene. Thus, according to examples of the presently disclosed subject matter, managing 3D capture can include managing operation of at least one resource that is involved in the 3D capture or managing operation of at least one software feature of the 3D capture. It would be appreciated that at least in some respects, in some cases, or under certain conditions modifying the operation of a resource that is involved in the 3D capture can affect the operation of at least one software feature of the 3D capture, and vice versa. - Referring to
FIG. 15 (and tosystem 200 generally), it is noted thatsystem 200 may be implemented as a mobile communication device, such as a smartphone, a lap-top computer or another hand-held device. As can be seen in Fig. Error! Reference source not found., and by way of example,system 200 may include a various components that are capable of providing 3D depth or range data. In the example ofFIG. 15 there is shown a configuration ofsystem 200 which includes anactive 10, but in further examples of the presently disclosed subject matter other known 3D cameras can be used. Those versed in the art can readily apply the teachings provided in the examples of the presently disclosed subject matter to other 3D camera configurations and to other 3D capture technologies.stereo 3D camera - By way of example, the
3D camera 10 can include: a 3D capture sensor 12 (which may optionally be part of the aforementionedimaging sensing unit 250 or replace it), adriver 14, a 3D capture processor 16 (which may optionally be part of theaforementioned processing unit 250 or replace it).System 200 also includes aprojection module 18, which includesemitter array 210,optical subunit 220 andDOE 230. Optionally,projection module 18 may further includeoutput optics 240. - In this example, the
projection module 18 is configured to project a structured light pattern and the3D capture sensor 12 is configured to capture an image which corresponds to the reflected pattern, as reflected from the environment onto which the pattern was projected. U.S. Pat. No. 8,090,194 to Gordon et. al. describes an example structured light pattern that can be used in a projection module component of a 3D camera, as well as other aspects ofactive stereo 3D capture technology and is hereby incorporated into the present application in its entirety. International Application Publication No. WO2013/144952 describes an example of a possible projection module design (also referred to as “flash design”), and is hereby incorporated by reference in its entirety. - By way of example,
emitter array 210 which is included in theprojection module 18 may include an IR light source, such that it is capable of projecting IR radiation or light, and the3D capture sensor 12 can be and IR sensor, that is sensitive to radiation in the IR band, and such that it is capable of capturing the IR radiation that is returned from the scene. Theprojection module 18 and the3D capture sensor 12 are calibrated. According to examples of the presently disclosed subject matter, thedriver 14, the3D capture processor 16 or any other suitable component of thesystem 200 can be configured to implement auto-calibration for maintaining the calibration among theprojection module 18 and the3D capture sensor 12. - The
3D capture processor 16 can be configured to perform various processing functions, and to run computer program code which is related to the operation of one or more components of the 3D camera. The3D capture processor 16 can includememory 17 which is capable of storing the computer program instructions that are executed or which are to be executed by theprocessor 16. - The
driver 14 can be configured to implement a computer program which operates or controls certain functions, features or operations that the components of the3D camera 10 are capable of carrying out. - According to examples of the presently disclosed subject matter,
system 200 can also include hardware components in addition to the3D camera 10, including for example, apower source 20,storage 30, acommunication module 40, adevice processor 40 andmemory 60 device imaging hardware 110 adisplay unit 120 andother user interfaces 130 . It should be noted that in some examples of the presently disclosed subject matter, one or more components ofsystem 200 can be implemented as distributed components. In such examples, a certain component can include two or more units distributed across two or more interconnected nodes. Further by way of example, a computer program, possibly executed by thedevice processor 40, can be capable of controlling the distributed component and can be capable of operating the resources on each of the two or more interconnected nodes. - It is known to use various types of power sources in a mobile communication device. The
power source 20 can include one or more power source units, such as a battery, a short-term high current source (such as a capacitor), a trickle-charger, etc. - The
device processor 50 can include one or more processing modules which are capable of processing software programs. The processing module can each have one or more processors. In this description, thedevice processor 50 different types of processor which are implemented insystem 200, such as a main processor, an application processor, etc.). Thedevice processor 50 or any of the processors which are generally referred to herein as being included in the device processor can have one or more cores, internal memory or a cache unit. - The
storage unit 30 can be configured to store computer program code that is necessary for carrying out the operations or functions ofsystem 200 and any of its components. Thestorage unit 30 can also be configured to store one or more applications, including3D applications 80, which can be executed onsystem 200. In a distributed configuration one ormore 3D applications 80 can be stored on a remote computerized device, and can be consumed bysystem 200 as a service. In addition or as an alternative to application program code, thestorage unit 30 can be configured to store data, including for example 3D data that is provided by the3D camera 10. - The
communication module 40 can be configured to enable data communication to and from the mobile communication device. By way of example, examples of communication protocols which can be supported by thecommunication module 40 include, but are not limited to cellular communication (3G, 4G, etc.), wired communication protocols (such as Local Area Networking (LAN)), and wireless communication protocols, such as Wi-Fi, wireless personal area networking (PAN) such as Bluetooth, etc. - It should be noted that that according to some examples of the presently disclosed subject matter, some of the components of the
3D camera 10 can be implemented on the mobile communication hardware resources. For example, instead of having a dedicated3D capture processor 16, thedevice processor 50 can be used. Still further by way of example,system 200 can include more than one processor and more than one type of processor, e.g., one or more digital signal processors (DSP), one or more graphical processing units (GPU), etc., and the 3D camera can be configured to use a specific one (or a specific set or type) processor(s) from the plurality of device 100 processors. -
System 200 can be configured to run anoperating system 70. Examples of mobile device operating systems include but are not limited to: such as Windows Mobile™ by Microsoft Corporation of Redmond, Wash., and the Android operating system developed by Google Inc. of Mountain View, Calif.. It is noted that ifsystem 200 is not a mobile system, other operating systems may be used (e.g. Windows, Linux, etc.). - The
3D application 80 can be any application which uses 3D data. Examples of 3D applications include a virtual tape measure, 3D video, 3D snapshot, 3D modeling, etc. It would be appreciated that different 3D applications can have different requirements and features. A3D application 80 may be assigned to or can be associated with a 3D application group. In some examples, the device 100 can be capable of running a plurality of3D applications 80 in parallel. -
Imaging hardware 110 can include any imaging sensor, in a particular example, an imaging sensor that is capable of capturing visible light images can be used. According to examples of the presently disclosed subject matter, theimaging hardware 110 can include a sensor, typically a sensor that is sensitive at least to visible light, and possibly also a light source (such as one or more LEDs) for enabling image capture in low visible light conditions. According to examples of the presently disclosed subject matter, thedevice imaging hardware 110 or some components thereof can be calibrated to the3D camera 10, and in particular to the3D capture sensor 12 and to theprojection module 18. It would be appreciated that such a calibration can enable texturing of the 3D image and various other co-processing operations as will be known to those versed in the art. - In yet another example, the
imaging hardware 110 can include a RGB-IR sensor that is used for capturing visible light images and for capturing IR images. Still further by way of example, the RGB-IR sensor can serve as the3D capture sensor 12 and as the visible light camera. In this configuration, thedriver 14 and theprojection module 18 of the 3D camera, and possibly other components of the device 100, are configured to operate in cooperation with theimaging hardware 110, and in the example given above, with the RGB-IR sensor, to provide the 3D depth or range data. - The
display unit 120 can be configured to provide images and graphical data, including a visual rendering of 3D data that was captured by the3D camera 10, possibly after being processed using the3D application 80. Theuser interfaces 130 can include various components which enable the user to interact withsystem 200, such as speakers, buttons, microphones, etc. Thedisplay unit 120 can be a touch sensitive display which also serves as a user interface. - The
3D capture processor 16 or thedevice processor 50 or any sub-components or CPU cores, etc. of such processing entities can be configured to process a signal that is received from the3D capture sensor 12 or from thedevice imaging hardware 110, in case thedevice imaging hardware 110 is capable of and is configured to serve the3D camera 10. For convenience, in the following description, thecore 3D capture functions shall be attributed, in a non-limiting manner, to the3D capture processor 16 and to the3D capture processor 16. However, it would be appreciated that the functionality and task allocation between the various components and sub components ofsystem 200 are often a design choice. - According to examples of the presently disclosed subject matter, the
3D capture processor 16 can be configured to collect imaging data, process the imaging data, analyze the imaging data, produce imaging results, imaging content, and/or imaging display, etc. - According to examples of the presently disclosed subject matter, the
3D capture processor 16 can receive as input an IR image and calibration information. By way of example, the calibration information may relate to IR sensor (as an example of a 3D capture sensor) and projector (such as the projection module 18). In some examples of the presently disclosed subject matter, the3D capture processor 16 can also receive as input a color image, e.g., from thedevice imaging hardware 110, and a color camera—IR camera calibration information. - By way of example, the processing that is carried out by the
3D capture processor 16 can include pre-processing, optical character recognition (OCR), error correction and triangulation. The pre-processing function can include operations for removing sensor noise and for improving signal quality, e.g., by resolving optical issues, such as speckles. The OCR function translates areas in the image to one of a plurality of code words that were used in the pattern that was projected by theprojection module 18 and which was captured by the3D capture sensor 12. The error correction operation can include computations which use pre-existing knowledge on the projected pattern/code to correct erroneous labeling of code words or of features of code words (which can lead to changing of a label of one or more code words). The triangulation function takes into account the imaging geometry to extract the depth information. An example of a triangulation procedure that is made with reference to active triangulation methods is provided in U.S. Pat. No. 8,090,194 to Gordon et al. - According to examples of the presently disclosed subject matter, the
3D capture processor 16 can also perform a color projection function, whereby the color from a color sensor (e.g., from the device imaging hardware 110) is projected onto the 3D data. It would be appreciated that the color projection function (as any other function described here with reference to the 3D capture processor 16) can be carried out by thedevice processor 50 or any processing component thereof. - Additional processes which may involve processing operations and which can be implemented as part of a 3D data processing pipeline for certain 3D applications can (but not necessarily) include some (e.g., one, two, three, . . . ) of the following: live system control (e.g., auto gain, auto exposure, control of active source power and pulse duration, etc.), point cloud registration, denoising, feature classification, feature tracking, various 3D vision uses, passive camera processing (e.g., pose estimations, shape from motion etc.), inertial measurement unit (IMU) processing (e.g, kalman filters), time stamping, ISP functions (demosaic, gama correction), compression, calibration quality monitoring, etc. It would be appreciated that the above operations can be carried out on the
3D capture processor 16, on thedevice processor 50 or on both (the processing tasks can be divided among the various processing resource, either in advance or in real-time). - According to examples of the presently disclosed subject matter, the
3D camera 10, after processing of the signal from thesensor 12 and possibly from other sources, can be configured to provide as output one or more of the following: a set of 3D points, typically with normals (point cloud), where the normals can be computed using adjacent points; a textured mesh—triangulation (generating polygonal surface) using adjacent; depth map with color map (color projection). Those versed in the art would appreciate that additional outputs can be provided by the3D camera 10. As mentioned above, some of the processing attributed in some examples of the presently disclosed subject matter to the3D camera 10 and to the3D capture processor 16 can be carried out outside the3D camera 10, and in particular by thedevice processor 50, and so some of the output which are attributed here to the3D camera 10 can be generated outside what is referred to as the 3D camera in the examples shown inFIG. 15 and in the description ofFIG. 15 provided herein. - According to examples of the presently disclosed subject matter, the
device processor 50, possibly in cooperation with the3D capture processor 16, can be configured to determine or receive data with respect to the state of the resources of the mobile communication system 100. The resources state data can be organized in any suitable form. For example, related or alternative resources can be grouped, resources which are linked by some tradeoff can be linked, resources whose usage crossed some threshold can be grouped, etc. - According to examples of the presently disclosed subject matter , in addition to the usage state information, the
device processor 50 can be configured to obtain or receive, e.g., from thememory 60, additional information which can be useful for determine the usage state of one or more resources ofsystem 200. For example, thedevice processor 50 can obtain data which relates to expected resources usage, for example, as result of scheduled tasks or based on statistics with respect to the device 100 or its resources behavior in terms of resource usage and/or based on statistics with respect to the behavior of applications running on the device in terms of resource usage. In another example, expected resources usage can relate to tasks that are expected to be carried out, either as a result of processes that are already running one the mobile communication device, or for any other reason. - According to examples of the presently disclosed subject matter, the term “resource availability profile” is used in the description and in the claims to describe the data that is used in the mobile communication device to describe the current or expected state of one or more resources of the mobile communication device, in particular to describe the state of the resources that are associated with the operation of a 3D application, or which are expected to be effected by the operation of a 3D application or any of its features.
- According to examples of the presently disclosed subject matter, the
device processor 50 can be configured to continuously monitor the state of the resources ofsystem 200 and can update to resource availability profile accordingly. In further examples of the presently disclosed subject matter thedevice processor 50 can be configured to routinely monitor the resources state and update the resource availability profile, where the timing of the update is either determine according to predefined intervals, or is determined based on some input that is received at the device processor. In yet another example, thedevice processor 50 updates to resource availability profile when a certain event occurs, such as an event which effects the availability of at least one resource of the mobile communication device. - Throughout the description and in the claims reference is made to the term “3D application”. The
term 3D application as used herein relates to a computer program code that can run as an application on a mobile communication platform (whether hosted locally or whether hosted remotely and consumed as a service on a mobile communication device), and which computer program code embodies at least one feature which uses 3D data, in particular 3D data that is provided by or obtained from a 3D camera. Such a feature is termed in the description and in the claims as a 3D capture feature. Many examples of 3D applications exist in the market and the following are a small sample of which: a virtual tape measure, a room modeling environment, 3D segmentation and model creation, augmented reality games, etc. - It would be appreciated that a 3D application, or a 3D capture feature of a 3D application can have certain attributes characteristics and requirements. Furthermore, in order to enable, support and/or execute different 3D capture features, different resources (hardware resource but possibly also software resources) allocation requirements can exist (including different levels of a given resource), or from another perspective, or according to different implementations, different 3D capture features can consume different resources (including different levels of a given resource).
- For example, assume a 3D conferencing application having a full-view feature and a face-only feature, where the full scene feature involves capturing and
processing 3D data from the entire field of view of the sensor, and the face-only feature involves utilizing only the resources that are required for obtaining 3D data of an area in the scene where the face of a person facing the 3D capture sensor is detected. Among the two features, it is highly probable that the full view feature of the 3D capture application will consume greater processing, memory and power resources compared to the face only feature. - According to examples of the presently disclosed subject matter, a given feature of a given
3D application 80 can be associated with a particular part of the software program code of the 3D application. Alternatively or additionally, a feature of a3D application 80 can be associated with a particular resource, such a particular hardware component or a particular software program code external to3D application 80 and running onsystem 200. For example, a feature of a 3D application can be associated with an inertial measurement unit (not shown) ofsystem 200. - According to examples of the presently disclosed subject matter, for each feature there can be provided a cost measure. The term “cost measure” as used herein and in the claims relates to a measure of a feature's estimated, expected or measured consumption of a given resource or of a resource group, or of one resource from a resource group, or the measure can be global measure of the feature's resource consumption. In yet further example, the cost measure can relate to the feature's estimated, expected or measured consumption of a resource or resources at a given mode of the respective 3D capture application.
- By way of example, the cost measure of each feature can include a plurality of measures for a plurality of resources. Still further by way of example, the cost measure can include measures for alternative resources, and such measures and the resources with which they are associated can be indicated as alternatives. It would be noted that providing such alternative measures can enable preforming various tradeoff computations including with respect to different configurations of a given feature, and in another example, with respect to implementation of different features in different 3D applications or in different operational mode of a given (the same) 3D application.
- Furthermore, it is possible that two or more 3D applications which are functionally connected to one another would be executed in
system 200, and the relation between the 3D applications can be indicated, e.g., to thedevice processor 50, and thedevice processor 50 can be configured to take into account the relations and cross effect of the related 3D applications of some features thereof when processing a cost measure of a given feature of one of the related 3D applications. - By way of example the cost measure of a given 3D application feature can be provided as explicit data that is stored as part of the feature program code, or that is otherwise associated with the feature program code. In a further example, the cost measure of a given 3D application feature can be determined (e.g., calculated) based on previous behavior of the feature and of one or more resources which are utilized to enable the feature. In yet further examples, the cost measure of a given 3D application feature can be determined based on statistical data, for example, based on the resource consumption of related features, possibly of related 3D applications, and possibly also under similar operating conditions, on similar mobile communication devices, etc.
- The cost measure can be provided in various forms. For example, the cost measure can include information related to an amount or level of power (electricity) consumption, capacity consumption (e.g. consumption of processing power, consumption of memory, consumption of communication bandwidth, etc.). In another example, the cost measure can provide a measure of an aspect of user experience such as increased or reduced latency, frame rate, accuracy of output, etc.
- According to examples of the presently disclosed subject matter, in addition to the cost measure of a given feature of a 3D capture application, a functional measure can be obtained with respect to the feature. The term “functional measure” as used herein relates to an indication provided in respect of the functional value of a 3D capture application feature in respect of which the functional measure is provided. By way of example, the functional value of a feature indicates the value, importance or contribution of the feature to the user experience. In another example, the functional value of a feature indicates the value, importance or contribution of the feature for enabling additional features of the 3D capture application, or the value, importance or contribution of the feature for enabling features of other applications.
- Still further by way of example the functional measure of a given feature can relate to a specific mode of operation of the respective 3D capture application, and the functional measure relates to the functional value of the respective feature in the respective mode of the 3D capture application.
- According to examples of the presently disclosed subject matter, each 3D application can have at least one mode of operation. According to examples of the presently disclosed subject matter, a 3D application can include a live-mode. The term “live-mode of a 3D capture application” (or “live-mode” in short) as used in the description and in the claims relates to a mode of the 3D application in which instant (real time or near real time, e.g., up to 1 second of latency) feedback is provided (e.g., presented on a display) to a user (human or program) of the 3D application. Still further by way of example, the feedback provided in the live mode of the 3D application, possibly together with additional features of the live mode, can facilitate a certain measure of control over the an ongoing capturing process of 3D data. For example, instant feedback which is provided by the mobile communication device in the live mode of a 3D application can enable modification of one or more configurations and/or features or usage of at least one resource of the mobile communication device the modify the results of the ongoing 3D capture process. Examples of modification which can be enabled by the live mode include changing an orientation of the 3D imaging components, modifying a level of illumination provided by the projector, changing the type of pattern that is used by the projector, and control over software resources of the mobile communication device, such as modifying a level of gain applied to the incoming signal from the sensor, changing the type of error correction used in the decoding process, etc.
- According to examples of the presently disclosed subject matter, a resource of the mobile communication device, as used herein can relate to a component or a sub-component, a firmware routine, or a software program running of the mobile communication device.
- As would be appreciated by those versed in the art, in case a 3D application also operates at a non-live mode, the hardware and/or software configuration that is used in the 3D capture live-mode can have effect on operation of the non-live mode of the 3D application, and can have an effect on the resources that are used in the non-live mode of the 3D application, including the level of usage, etc. In another example, the stream of data that is passed on a non-live mode of the 3D capture, e.g., for further processing can also be influenced by the actual implementation of the live-mode of the respective 3D application.
- In the present disclosure and in the claims, the term “non-live mode of a 3D application” (or “non-live mode” in short) (e.g., latency is above 1 second or above 2-3 seconds), relates to a mode of operation of a 3D application, other than a live mode. According to examples of the presently disclosed subject matter, a non-live mode of a 3D application is a mode which does not take place concurrently with the 3D capture operation. Still by way of example, a non-live mode of a 3D application usually involves further utilization of resources, including, for example, further processing of the 3D data. Still further by way of example, the non-live mode can include further processing by the
device processor 50 ofsystem 200 or in another example, further processing by external (and remote) resources. - It would be appreciated that in addition to the live-mode of a given 3D application several non-live modes can exist, each of which can have different features, or features that have different configurations. By way of example, the modes can differ from one another in the amount of latency, as well as in other characteristics.
- According to examples of the presently disclosed subject matter, a given mode of a 3D application can include at least two features, where the two features are alternative to one another, and wherein in the given mode of the application it is possible to use only one of the two features. Further by way of example, each one of the two alternative features can have a different resource consumption.
- According to examples of the presently disclosed subject matter, two different modes of a certain 3D application can have one or more common 3D application features. Further by way of example, a given feature of a 3D application can have a different configuration or different characteristics in different modes of a given 3D application. It would be noted, a given feature which can have different resource consumption characteristics in different configurations of the feature. In case a 3D application that is subject to the resource management procedure according to examples of the presently disclosed subject matter, has identical sets of features across two modes of operation which are used in the resource management procedure, at least one of the features can have a different configuration in each of the two modes of operation.
- In other examples, two different modes of a certain 3D application can have entirely different features (none of the features is common).
- According to a further aspect of the presently disclosed subject matter, a 3D application or given features of a 3D application can have a local mode and a remote mode. According to examples of the presently disclosed subject matter, in the local mode of a given feature most, including all, of the resources which are consumed by the feature of the 3D application reside locally or are mostly local features of the mobile communication device, and in the remote mode of the feature most, including all, of the resources which are consumed by the feature are local on a remote node (are external to the mobile communication device), e.g, most of the resources are in the cloud.
- In one example, the
3D capture processor 16 or thedevice processor 50 can be configured to determine which feature of a3D application 80 to use in a given mode of the application, or whether to use a feature of a first mode of the 3D application or a feature of a second mode of the 3D application based on resource availability information relating to an availability or to a state of one or more resource of the mobile communication device, such battery power, processing power, memory resources, communication bandwidth, availability of remote processing, etc. Still further by way of example the decision regarding which feature to use in particular mode can be further based on one or more hardware cost parameters which are associated with the feature. -
FIG. 16 is a block diagram illustration of a system according to examples of the presently disclosed subject matter, including support for a remote mode of a 3D capture application feature. As can be seen inFIG. 16 , thesystem 900 includes acloud platform 910, which includes resources that enable remote implementation of some or all of the process which are associated with a given feature of a 3D capture application. -
FIG. 17 is a flow chart illustrating an example ofmethod 500, in accordance with examples of the presently disclosed subject matter.Method 500 is a method for projection. It is noted thatmethod 500 may be implemented by a system such assystems systems method 500, mutatis mutandis. - Stage 510 of
method 500 includes emitting a plurality of light beams. Optionally, the plurality of light beams is emitted by a plurality of individual emitters, each of the plurality of individual emitters emitting one of the plurality of light beams. Referring to the examples set forth with respect to the previous drawings,stage 510 may be implemented byemitters 212. It is noted that emitters which are used for the emitting ofstage 510 may be included in a single emitters array (e.g. encased as a single unit, e.g. having a united power supply), but this is not necessarily so. - As aforementioned with respect to
emitters 212, each emitter which is used for the emitting ofstage 510 may be a vertical-cavity surface-emitting laser (VCSEL) emitter, but this is not necessarily so, and other type of emitters (and especially other laser emitters) may be used. - Stage 520 of
method 500 includes transforming the plurality of light beams.Stage 520 includes at least one ofstages 521 of expanding the plurality of light beams, and/or stage 522 of collimating of the plurality of light beams. Referring to the examples set forth with respect to the previous drawings,stage 520 may be implemented byoptical subunit 220. As aforementioned with respect tooptical subunit 220, the optical subunit used for the transforming may include a plurality of optical elements having a common optical axis common to the plurality of optical elements. The common optical axis may be folded once or more, but this is not necessarily so. - Stage 540 of
method 500 includes diffracting the transformed light beams by a diffractive optical element (DOE) to provide light patterns.Stage 540 may include diffracting the transformed light beams by the DOE to provide a structured light pattern which includes the light pattern provided by diffraction of each of the transformed light beams. Referring to the examples set forth with respect to the previous drawings,stage 540 may be implemented byDOE 230. -
Stage 540 may be preceded bystage 530 of directing the transformed light beams toward the DOE.Stage 530 is illustrated, for example, inFIG. 18 . Referring to the examples set forth with respect to the previous drawings,stage 530 may be implemented byoptical subunit 220. - Optionally,
stage 520 of transforming may be executed by a telecentric optical subunit. Optionally, the transforming ofstage 520 may be executed by an optical subunit, wherein the emitting is executed by a plurality of individual emitters which are positioned on a focal plane of the optical subunit. - Optionally, the method may include transforming the plurality of light beams which propagates in substantially parallel paths to an optical subunit which executes the transforming. Optionally, these parallel paths may be common to an optical axis of the optical subunit.
-
FIG. 18 is a flow chart illustrating an example ofmethod 500, in accordance with examples of the presently disclosed subject matter. It is noted that not all of the stages which are illustrated inFIG. 18 should necessarily be implemented together, and that any combination of any of the optional stages may be implemented. - Optionally,
stage 510 may include stage 511 of emitting the plurality of light beams by an emitter array including a plurality of emitters which are arranged in non-uniform spacing between the emitters (i.e. in spaces which differ in dimension, e.g. depending on the distance of an individual emitter from the optical axis). This may be used to improve the tiling between the projected light patterns, e.g. as discussed with respect toFIGS. 12A-12G . - Referring to stage 540 of diffracting the transformed light beams, it is noted that optionally, the plurality of light patterns provided by the diffractive optical element are copies of a predetermined light pattern. In other words, stage 540 may include
stage 541 of diffracting each of the transformed light beams to provide a plurality of light patterns which are copies of a predetermined light pattern. Optionally,stage 541 may include diffracting each of the light patterns by the DOE to provide a copy of the predetermined pattern. - While not necessary so, the copies of the predetermined light pattern (if implemented) may be adjacent to each other. This may be used for tiling an area whose size is much larger (e.g. at least 50 times larger) than a size of any of the projected copies of the predetermined light pattern. This way, a relatively simple DOE (which is cheaper to design and to manufacture) which is designed to diffract an incident coherent light beam to provide a relatively simple light pattern—may be used to generate much larger and more complex or intricate structured light pattern, e.g. as demonstrated (in small scale, only 6 times larger) in
FIG. 4A .Stage 541 may include stage 542 of diffracting the transformed light beams to provide a plurality of copies of a predetermined light pattern which are adjacent to each other. - Optionally, generating of the plurality of copies of the predetermined light pattern according to method 500 (e.g. using a single DOE) facilitates projection of a high contrast and high clarity overall output pattern of the optical system.
- It is noted that
stage 540 may includestage 543 of diffracting the transformed light beams to provide light patterns which partly overlap each other. The partly overlapping light patterns may be copies of the predetermined light pattern (in which case each provided copy of the predetermined light pattern partly overlaps at least one other provided copy of the predetermined light pattern), but this is not necessarily so. Each of the partly overlapping light patterns may be diffracted from a light beam arriving from a single emitter, but this is not necessarily so. - Optionally, if
stage 543 is implemented, the predetermined light pattern may include multiple copies of a repeated subpattern, wherein in each provided copy of the predetermined light pattern at least one subpattern overlaps a subpattern of at least one other provided copy of the predetermined light pattern generated by light originating from another light emitter. Further discussion is provided with respect toFIG. 4C . - Optionally,
stage 510 of emitting the plurality of light beams may include stage 511 of controlling activation of different subgroups of emitters at different times, thereby resulting in providing of offset overall output patterns of the optical system at different times. Optionally, the light patterns provided by diffracting the light of each of the light emitters in each of the subgroups may be copies of the predetermined light pattern, but this is not necessarily so. - With respect to the emitting of
stage 510, it is noted that the emitting may be executed by an emitter array which is dense with individual emitters of coherent light beams, thereby enabling spatially efficient providing of a high energy structured light pattern. - With respect to stage 510, optionally, the emitter array may include a plurality of individual emitters arranged so as to form a planar emission plane. That is, optionally,
stage 510 of emitting the plurality of light beams may include emitting the plurality of light beams by an emitter array which include a plurality of individual emitters arranged so as to form a planar emission plane. Referring to the examples set forth with respect to the previous drawings, such an emitter as discussed with respect toFIG. 13 , and all of the discussion which pertains toFIG. 13 is applicable to such a variation ofstage 510, mutatis mutandis. - Referring to
method 500 as a whole, a combination of (a) the optical subunit used instage 520 and (b) the diffractive optical element used instage 540 is characterized by a distortion function. Optionally, the emitter array used for the emitting ofstage 510 may include a plurality of individual emitters which are arranged in a non-uniform configuration whose relation to a predefined uniform grid is an inverse function of the distortion function. That is,stage 510 may include emitting the plurality of light beams by an emitter array which includes a plurality of individual emitters which are arranged in a non-uniform configuration whose relation to a predefined uniform grid is an inverse function of the distortion function. - An example of the distortion function of
optical subunit 220 is presented inFIGS. 12D and 12E . As can be seen, a regular grid ofindividual emitters 212 inFIG. 12D is transformed into a non-regular array of illumination.Method 900 inFIG. 25 discloses a method which may be used to determine the distortion function, and based on which to determine a non-uniformed configuration which may be used for the individual emitters ofsystem 205. -
FIG. 19 is a flow chart illustrating an example ofmethod 600, in accordance with examples of the presently disclosed subject matter. - It is noted that
method 600 may incorporate any of the stages and variations discussed above with respect tomethod 500 as general. Furthermore,method 600 may incorporate any of the stages and variations discussed below with respect tomethod 700 and tomethod 800. The stages ofmethod 600 are denoted using the similar numeral reference used for the stages ofmethod 500, increased by 100 (e.g. stage 610 is comparable tostage 510, and so on), and the variations discussed with respect to these stages in other parts of the document may also pertain, mutatis mutandis, tomethod 600. Referring to the examples set forth with respect to the previous drawings,method 600 may be implemented bysystem 201. - Stage 610 of
method 600 includes emitting a plurality of light beams. Each of the plurality of light beams emitted instage 610 is characterized by a native beam width. -
Stage 620 includes transforming the plurality of light beams so that each of the transformed light beams is characterized by an expanded beam width that is wider than the native beam width of the corresponding light beam and is wider than a facilitating beam width. Referring to the examples set forth with respect to the previous drawings,stage 620 may be implemented byoptical subunit 220. -
Stage 640 includes diffracting the transformed light beams by a diffractive optical element (DOE) to provide light patterns whose angular resolution meets a light pattern target angular resolution criteria. Referring to the examples set forth with respect to the previous drawings,stage 640 may be implemented byDOE 230. - Referring to stage 610, optionally the emitting of
stage 610 may include emitting the plurality of light beams whose native beam widths are narrower than the facilitating beam width by at least one order of magnitude. -
FIG. 20 is a flow chart illustrating an example ofmethod 600, in accordance with examples of the presently disclosed subject matter. It is noted that not all of the stages which are illustrated inFIG. 20 should necessarily be implemented together, and that any combination of any of the optional stages may be implemented. -
Method 600 may includestage 630 of directing the transformed light beams toward the DOE. Referring to the examples set forth with respect to the previous drawings,stage 630 may be implemented byoptical subunit 220. -
Stage 630 may include stage 631 of deflecting (by refraction or otherwise) the plurality of light beams and projecting the plurality of transformed light beams onto the diffractive optical element at different angles of incidence. Referring to the examples set forth with respect to the previous drawings,stage 630 may be implemented byoptical subunit 220. -
Stage 640 which follows stage 630 (if implemented) includes providing a plurality of light patterns by the diffractive optical element, and providing a structured light pattern which includes the plurality of light patterns. - Optionally,
stage 620 may include reducing beam divergence of the light beam. For example, if each light beam out of the plurality of light beams is characterized by a first beam divergence of that beam,stage 620 may includestage 621 of transforming the plurality of light beams so that each of the transformed light beams is characterized by a second beam divergence that is smaller than the first beam divergence of the corresponding light beam. - Optionally,
stage 620 may includestage 621 of transforming the plurality of light beams so that the expanded beam widths of each of the plurality of transformed light beams is at least 3 times larger than the native beam width of the corresponding light beams. -
FIG. 21 is a flow chart illustrating an example ofmethod 700, in accordance with examples of the presently disclosed subject matter. It is noted thatmethod 700 may incorporate any of the stages and variations discussed above with respect tomethod 500 as general. Furthermore,method 700 may incorporate any of the stages and variations discussed below with respect tomethod 600 and tomethod 800. The stages ofmethod 700 are denoted using the similar numeral reference used for the stages ofmethod 500, increased by 100 (e.g. stage 710 is comparable tostage 510, and so on), and the variations discussed with respect to these stages in other parts of the document may also pertain, mutatis mutandis, tomethod 700. Referring to the examples set forth with respect to the previous drawings,method 700 may be implemented bysystem 202. - Stage 710 of
method 700 includes emitting a plurality of light beams. Each of the light beams emitted instage 710 is characterized by a first beam divergence of that beam. Referring to the examples set forth with respect to the previous drawings,stage 710 may be implemented byemitter array 210. - Stage 720 of
method 700 includes transforming the plurality of light beams so that each of the transformed light beams is characterized by a second beam divergence that is smaller than the first beam divergence of the corresponding light beam. Referring to the examples set forth with respect to the previous drawings,stage 720 may be implemented byoptical subunit 220. - Optionally, the transforming may be executed by an optical subunit which is an optical assembly including a plurality of optical elements having a common optical axis common to the plurality of optical elements.
- Optionally, the transforming may be executed by an optical subunit which is operable to transform the plurality of light beams to provide the plurality of transformed light beams using transforming optical components (included in the optical subunit) which are common to the plurality of light beams.
- Stage 740 of
method 700 includes diffracting the transformed light beams by a diffractive optical element (DOE) to provide light patterns. - With respect to
method 700, it is noted that a facilitating beam divergence may be defined for the DOE (used in stage 740), so that incidence upon the DOE of coherent light beams whose divergence is lower than the facilitating beam divergence result in provision of light patterns whose contrast meets a light pattern target contrast criteria. - The transforming and the diffracting of the light beam in
method 700 may be implemented so that the second beam divergences of the plurality of transformed light beams are lower than the facilitating beam divergence. -
FIG. 22 is a flow chart illustrating an example ofmethod 700, in accordance with examples of the presently disclosed subject matter. It is noted that not all of the stages which are illustrated inFIG. 22 should necessarily be implemented together, and that any combination of any of the optional stages may be implemented. -
Stage 710 may includestage 711 of emitting the plurality of light beams so that the first beam divergence of any of the emitted light beams is larger than the facilitating beam divergence by at least one order of magnitude. -
Method 700 may includestage 730 of directing the transformed light beams toward the DOE. Referring to the examples set forth with respect to the previous drawings,stage 730 may be implemented byoptical subunit 220. Referring to the examples set forth with respect to the previous drawings,stage 730 may be implemented byoptical subunit 220. -
Stage 730 may include stage 731 of deflecting (by refraction or otherwise) the plurality of light beams and projecting the plurality of transformed light beams onto the diffractive optical element at different angles of incidence. Referring to the examples set forth with respect to the previous drawings,stage 730 may be implemented byoptical subunit 220. -
FIG. 23 is a flow chart illustrating an example ofmethod 800, in accordance with examples of the presently disclosed subject matter. It is noted thatmethod 800 may incorporate any of the stages and variations discussed above with respect tomethod 500 as general. Furthermore,method 800 may incorporate any of the stages and variations discussed below with respect tomethod 600 and tomethod 700. The stages ofmethod 800 are denoted using the similar numeral reference used for the stages ofmethod 500, increased by 100 (e.g. stage 810 is comparable tostage 510, and so on), and the variations discussed with respect to these stages in other parts of the document may also pertain, mutatis mutandis, tomethod 800. Referring to the examples set forth with respect to the previous drawings,method 800 may be implemented bysystem 203. - Stage 810 of
method 800 includes emitting a plurality of light beams. Referring to the examples set forth with respect to the previous drawings,stage 810 may be implemented byemitter array 210. - Stage 820 of
method 800 includes transforming the plurality of light beams.Stage 820 includes at least on of stages 821 of expanding the plurality of light beams, and/or stage 822 of collimating of the plurality of light beams. Referring to the examples set forth with respect to the previous drawings,stage 820 may be implemented byoptical subunit 220. As aforementioned with respect tooptical subunit 220, the optical subunit used for the transforming may include a plurality of optical elements having a common optical axis common to the plurality of optical elements. The common optical axis may be folded once or more, but this is not necessarily so. - Stage 830 of
method 800 includes directing the plurality of transformed light beams onto a diffractive optical element at different angles of incidence. Referring to the examples set forth with respect to the previous drawings,stage 830 may be implemented byoptical subunit 220. It is noted that the directing ofstage 830 may be done by the same optical components used for executingstage 820 of transforming the plurality of light beams, or at least partly by other optical components. - Stage 840 of
method 800 includes diffracting the plurality of transformed light beams by the diffractive optical element (DOE) to provide a plurality of light patterns. - Stage 840 of emitting includes
stage 841 of emitting the plurality of light beams by a plurality of individual emitters which are positioned so that for each of the individual emitters there is at least one other individual emitter positioned at a distance which is smaller than any beam width of any transformed light beam out of the plurality of transformed light beams. -
FIG. 24 is a flow chart illustrating an example ofmethod 500, in accordance with examples of the presently disclosed subject matter. It is noted thatstages methods stages -
Method 500 may further includestage 550 of projecting onto one or more objects at least a part of a structured light pattern which includes the plurality of light patterns. Referring to the examples set forth with respect to the previous drawings, the projecting ofstage 550 may be executed directly by the DOE (e.g. DOE 230), or by dedicated projecting optics (such as projecting optics 240). -
Method 500 may further includestage 560 of capturing an image of the object with the structured light pattern projected thereon. Referring to the examples set forth with respect to the previous drawings,stage 560 may be implemented by imaging sensingunit 250. -
Stage 560 may be followed bystage 570 of processing the image to determine range parameters. Referring to the examples set forth with respect to the previous drawings,stage 570 may be implemented by processingunit 260. - Optionally,
stage 570 may be followed bystage 580 of generating a 3D image of a scene which includes at least part of the object which is illuminated with the structured light pattern. Referring to the examples set forth with respect to the previous drawings, the description ofFIG. 15 may be applied, mutatis mutandis, to the process ofstage 580. -
FIG. 25 is a flow chart illustrating an example ofmethod 900, in accordance with examples of the presently disclosed subject matter.Method 900 may be used for determining an emitters layout. It is noted thatmethod 900 may be used to determine an emitters layout for the emitter array of a system such assystems systems method 900, mutatis mutandis, where applicable. - Stage 910 of
method 900 includes obtaining optical characteristics of a DOE positioned at a given distance from a light source. Referring to the examples set forth with respect to the previous drawings, the DOE may beDOE 230, and the light source may beemitter array 210. - Various kinds of optical characteristics may be obtained in various implementations of
stage 910. Some examples of optical characteristics which may be obtained instage 910 are: diffraction parameters of various areas on the DOE, size of the DOE, material of the DOE, shape of the DOE, and so on. - The obtaining of
stage 910 may be executed in various ways. For example,stage 910 may include retrieving the optical characteristics from a database. For example,stage 910 may include retrieving the optical characteristics from a tangible data storage medium (e.g. a compact disk, a hard-drive, a magnetic tape, a random-access memory, and so on). For example,stage 910 may include obtaining the optical characteristics by measuring and/or otherwise examining the DOE. Other ways of obtaining the optical characteristics may also be implemented. - Stage 920 of
method 900 includes obtaining data in respect of a provisional light beams emission layout through the DOE. - Various kinds of data in respect of a provisional light beams emission layout may be obtained in various implementations of
stage 910. Some examples of data in respect of a provisional light beams emission layout which may be obtained instage 920 are: distortion function of the DOE; distortion function of a combination of the DOE and connected optics (e.g.optical subunit 220 of system 220); design of the DOE, ray tracing simulation of light passing through the DOE, experimental result of light of the light source propagation through the DOE, and so on. - The obtaining of
stage 920 may be executed in various ways. For example,stage 920 may include retrieving the data in respect of a provisional light beams emission layout from a database. For example,stage 920 may include retrieving the data in respect of a provisional light beams emission layout from a tangible data storage medium (e.g. a compact disk, a hard-drive, a magnetic tape, a random-access memory, and so on). For example,stage 920 may include obtaining the data in respect of a provisional light beams emission layout by simulating light propagation through the DOE. For example,stage 920 may include obtaining the data in respect of a provisional light beams emission layout by emitting light from a light source through the DOE and measuring light propagation through the DOE. Other ways of obtaining the optical characteristics may also be implemented. - Stage 930 of
method 900 includes obtaining a target emission layout. Referring to the examples set forth with respect to the previous drawings, the target emission layout may be structuredlight pattern 150. Referring to the examples set forth with respect to the previous drawings, the target emission layout may belight pattern 140. - The obtaining of
stage 930 may be executed in various ways. For example,stage 930 may include retrieving the target emission layout from a database. For example,stage 930 may include retrieving the target emission layout from a tangible data storage medium (e.g. a compact disk, a hard-drive, a magnetic tape, a random-access memory, and so on). - Stage 940 of
method 900 includes determining an emitters layout based on the target emission layout and based on the provisional light beams emission layout. Referring to the examples set forth with respect to the previous drawings, the emitters layout determined instage 940 may be an emitter layout according to whichindividual emitters 212 ofemitter array 210 are arranged. - The determining of the emitters layout may include determining a 2D emitters layout (e.g. if a planar emission plane is used), and may also include determining a 3D emitters layout.
- Optionally,
stage 940 may include determining the emitters layout, such that light emitted by a light source positioned at the given distance from the DOE and having a plurality of emitters arranged according to the emitters layout is diffracted through the DOE is characterized by a layout (e.g. structured light, also referred below as the result structured light) that meets a target emission criterion that is based on the target emission layout. - For example, the target emission criterion (which may be a predefined criterion) may be that intensity differences between the intensity of the result structured light and the target emission layout at any point of the result structured light are below a certain (e.g. predefined) threshold, such as a certain percentage (say 90% or above. For example, the target emission criterion may be that the average intensity differences between the intensity of the result structured light and the target emission layout for the entire result structured light is below a certain (e.g. predefined) threshold, such as a certain percentage (say 90% or above).
- While certain features of the invention have been illustrated and described herein, many modifications, substitutions, changes, and equivalents will now occur to those of ordinary skill in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.
- It will be appreciated that the embodiments described above are cited by way of example, and various features thereof and combinations of these features can be varied and modified.
- While various embodiments have been shown and described, it will be understood that there is no intent to limit the invention by such disclosure, but rather, it is intended to cover all modifications and alternate constructions falling within the scope of the invention, as defined in the appended claims.
Claims (32)
1-139. (canceled)
140. An optical system, comprising:
an emitter array comprising a plurality of individual emitters, wherein each emitter in the emitter array is operable to emit a light beam which is characterized by a first beam divergence;
an optical subunit, operable to: (a) transform a plurality of light beams emitted by the emitter array, wherein each of the transformed light beams is characterized by a second beam divergence that is smaller than the first beam divergence of the corresponding light beam; (b) to direct the plurality of transformed light beams onto the diffractive optical element at different angles of incidence, resulting in providing of a plurality of light patterns by the diffractive optical element; and
a diffractive optical element that is capable of diffracting the transformed light beams to provide a plurality of light patterns.
141. The optical system according to claim 140 , wherein the second beam divergence is lesser than or equal to a facilitating beam divergence of the diffractive optical element.
142. The optical system according to claim 140 , wherein the optical subunit comprises a plurality of optical elements having a common optical axis.
143. The optical system according to claim 140 , wherein the optical subunit comprises transforming optical components which are common to the plurality of light beams.
144. The optical system according to claim 140 , wherein the emitter array and the optical subunit are positioned relative to one another such that the optical subunit further transforms the plurality of light beams by deflecting the plurality of light beams so that the plurality of transformed light beams are projected onto the diffractive optical element at different angles of incidence, resulting in providing of a plurality of light patterns by the diffractive optical element.
145. The optical system according to claim 140 , wherein a combination of the optical subunit and the diffractive optical element is characterized by a distortion function, wherein the plurality of individual emitters is arranged in a non-uniform configuration whose relation to a predefined uniform grid is an inverse function of the distortion function.
146. The optical system according to claim 140 , wherein the plurality of individual emitters is positioned on a focal plane of the optical subunit.
147. The optical system according to claim 140 , wherein the plurality of light patterns provided by the diffractive optical element are copies of a light pattern.
148. The optical system according to claim 147 , wherein each provided copy of the light pattern partly overlaps at least one other provided copy of the light pattern, wherein the light pattern comprises multiple copies of a repeated subpattern, wherein in each provided copy of the light pattern at least one subpattern overlaps a subpattern of at least one other provided copy of the light pattern generated by light originating from another light emitter.
149. The optical system according to claim 147 , further comprising an emitter array control system which is configured and operable to control activation of different subgroups of emitters of the emitter array, thereby resulting in providing of offset overall output patterns of the optical system at different times.
150. The optical system according to claim 140 , wherein a width of each one of the plurality of transformed light beams is greater than a beam width of a facilitating beam of the diffractive optical element.
151. The optical system according to claim 140 , wherein a width of each one of the plurality of transformed light beams is greater than the native beam width of the light beam.
152. The optical system according to claim 151 , wherein a width of each one of the plurality of transformed light beams is greater than the native beam width by at least a factor 3.
153. The optical system according to claim 140 , wherein for each individual emitter of the emitter array there is at least one other individual emitter of the emitter array positioned at a distance which is smaller than any beam width of any transformed light beam out of the plurality of transformed light beams.
154. The optical system according to claim 140 , wherein each of the plurality of individual emitters of the emitter array is a vertical-cavity surface-emitting laser emitter.
155. The optical system according to claim 140 , further comprising at least one processing unit, and wherein the optical system is operable to project onto an object at least a part of a structured light pattern which comprises the plurality of light patterns, and wherein the at least one processing unit is configured to decode an image of a reflected portion of the projected structured light pattern to determine range parameters.
156. A method for projection, the method comprising:
emitting a plurality of light beams, wherein each of the plurality of light beams is characterized by a first beam divergence;
transforming the plurality of light beams, so that each of the transformed light beams is characterized by a second beam divergence that is smaller than the first beam divergence of the corresponding light beam;
directing the plurality of the transformed light beams onto a diffractive optical element at different angles of incidence; and
diffracting the transformed light beams by a diffractive optical element to provide a plurality of light patterns.
157. The method according to claim 156 , wherein a combination of the optical subunit and the diffractive optical element is characterized by a distortion function, wherein the plurality of individual emitters is arranged in a non-uniform configuration whose relation to a predefined uniform grid is an inverse function of the distortion function.
158. The method according to claim 156 , wherein the second beam divergence is lesser than or equal to a facilitating beam divergence of the diffractive optical element.
159. The method according to claim 156 , wherein said transforming and said directing comprises using an optical subunit which is an optical assembly comprising a plurality of optical elements having a common optical axis.
160. The method according to claim 159 , wherein said transforming comprises using transforming optical components common to the plurality of light beams.
161. The method according to claim 156 , wherein the plurality of light beams are emitted by an emitter array, and the method further comprises positioning the emitter array and the optical subunit relative to one another such that the optical subunit further transforms the plurality of light beams by deflecting the plurality of light beams, and the method further comprises projecting the plurality of transformed light beams onto the diffractive optical element at different angles of incidence, thereby producing a plurality of light patterns
162. The method according to claim 161 , wherein the plurality of light patterns are copies of a light pattern.
163. The method according to claim 162 , wherein the plurality of copies of the light pattern are generated using the diffractive optical element as a single diffractive optical element, thereby facilitating projection of a high contrast and high clarity overall output pattern of the optical system.
164. The method according to claim 162 , wherein each provided copy of the light pattern partly overlaps at least one other provided copy of the light pattern, wherein the light pattern comprises multiple copies of a repeated subpattern, wherein in each provided copy of the light pattern at least one subpattern overlaps a subpattern of at least one other provided copy of the light pattern generated by light originating from another light emitter.
165. The method according to claim 156 , further comprising controlling activation of different subgroups of emitters of the emitter array, thereby resulting in providing of offset overall output patterns of the optical system at different times.
166. The method according to claim 161 , wherein the transforming is accomplished by an optical subunit, wherein the emitting is accomplished by a plurality of individual emitters which are positioned at a focal plane of the optical subunit.
167. The method according to claim 156 , further comprising:
projecting onto an object at least a part of a structured light pattern which comprises the plurality of light patterns; and
processing an image of a reflected portion of the projected structured light pattern to determine range parameters.
168. The method according to claim 156 , wherein a width of each one of the plurality of transformed light beams is greater than a beam width of a facilitating beam of the diffractive optical element.
169. The method according to claim 156 , wherein a beam width of each one of the plurality of transformed light beams is greater than the native beam width of the light beam.
170. The method according to claim 169 , wherein a width of each of the plurality of transformed light beams is greater than the native beam width by at least a factor 3.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/535,024 US20190361258A1 (en) | 2014-08-12 | 2019-08-07 | Structured light projection and imaging |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201462036158P | 2014-08-12 | 2014-08-12 | |
US14/823,008 US10409083B2 (en) | 2014-08-12 | 2015-08-11 | Structured light projection and imaging |
US16/535,024 US20190361258A1 (en) | 2014-08-12 | 2019-08-07 | Structured light projection and imaging |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/823,008 Continuation US10409083B2 (en) | 2014-08-12 | 2015-08-11 | Structured light projection and imaging |
Publications (1)
Publication Number | Publication Date |
---|---|
US20190361258A1 true US20190361258A1 (en) | 2019-11-28 |
Family
ID=55303109
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/822,961 Active 2035-08-19 US9915827B2 (en) | 2014-08-12 | 2015-08-11 | System, method and computer program product to project light pattern |
US14/823,008 Expired - Fee Related US10409083B2 (en) | 2014-08-12 | 2015-08-11 | Structured light projection and imaging |
US15/915,104 Active US10768435B2 (en) | 2014-08-12 | 2018-03-08 | System, method and computer program product to project light pattern |
US16/535,024 Abandoned US20190361258A1 (en) | 2014-08-12 | 2019-08-07 | Structured light projection and imaging |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/822,961 Active 2035-08-19 US9915827B2 (en) | 2014-08-12 | 2015-08-11 | System, method and computer program product to project light pattern |
US14/823,008 Expired - Fee Related US10409083B2 (en) | 2014-08-12 | 2015-08-11 | Structured light projection and imaging |
US15/915,104 Active US10768435B2 (en) | 2014-08-12 | 2018-03-08 | System, method and computer program product to project light pattern |
Country Status (3)
Country | Link |
---|---|
US (4) | US9915827B2 (en) |
CN (1) | CN106796661B (en) |
WO (2) | WO2016024200A2 (en) |
Families Citing this family (64)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE112009001652T5 (en) | 2008-07-08 | 2012-01-12 | Chiaro Technologies, Inc. | Multichannel recording |
US9562760B2 (en) | 2014-03-10 | 2017-02-07 | Cognex Corporation | Spatially self-similar patterned illumination for depth imaging |
WO2016024200A2 (en) | 2014-08-12 | 2016-02-18 | Mantisvision Ltd. | Structured light projection and imaging |
US10534970B2 (en) * | 2014-12-24 | 2020-01-14 | Datalogic Ip Tech S.R.L. | System and method for reading direct part marking (DPM) codes on objects |
US10616561B2 (en) * | 2015-09-03 | 2020-04-07 | Inuitive Ltd. | Method and apparatus for generating a 3-D image |
JP2017194418A (en) * | 2016-04-22 | 2017-10-26 | キヤノン株式会社 | Projection device, measurement device, and method for manufacturing article |
KR101733228B1 (en) * | 2016-04-28 | 2017-05-08 | 주식회사 메디트 | Apparatus for three dimensional scanning with structured light |
KR101892013B1 (en) | 2016-05-27 | 2018-08-27 | 엘지전자 주식회사 | Mobile terminal |
US10241244B2 (en) | 2016-07-29 | 2019-03-26 | Lumentum Operations Llc | Thin film total internal reflection diffraction grating for single polarization or dual polarization |
US10192311B2 (en) * | 2016-08-05 | 2019-01-29 | Qualcomm Incorporated | Methods and apparatus for codeword boundary detection for generating depth maps |
US10827163B2 (en) * | 2016-08-09 | 2020-11-03 | Facebook Technologies, Llc | Multiple emitter illumination source for depth information determination |
EP3500820A4 (en) * | 2016-08-18 | 2020-04-29 | Ramot at Tel-Aviv University Ltd. | Structured light projector |
ES2904556T3 (en) * | 2016-11-21 | 2022-04-05 | Carestream Dental Tech Topco Ltd | Characterization of the intraoral surface in 3D |
EP3349182A1 (en) * | 2017-01-13 | 2018-07-18 | Thomson Licensing | Method, apparatus and stream for immersive video format |
GB2552872B (en) * | 2017-05-17 | 2018-08-29 | Vision Rt Ltd | Patient monitoring system |
US20180347967A1 (en) * | 2017-06-01 | 2018-12-06 | RGBDsense Information Technology Ltd. | Method and apparatus for generating a random coding pattern for coding structured light |
US10551614B2 (en) * | 2017-08-14 | 2020-02-04 | Facebook Technologies, Llc | Camera assembly with programmable diffractive optical element for depth sensing |
CN109635619B (en) | 2017-08-19 | 2021-08-31 | 康耐视公司 | Encoding distance topology of structured light patterns for three-dimensional reconstruction |
US10586342B2 (en) | 2017-08-31 | 2020-03-10 | Facebook Technologies, Llc | Shifting diffractive optical element for adjustable depth sensing resolution |
EP3451023A1 (en) * | 2017-09-01 | 2019-03-06 | Koninklijke Philips N.V. | Time-of-flight depth camera with low resolution pixel imaging |
CN107450190B (en) | 2017-09-08 | 2019-12-13 | 深圳奥比中光科技有限公司 | Diffraction optical element and preparation method |
US11402197B2 (en) * | 2017-09-13 | 2022-08-02 | Sony Corporation | Distance measuring module |
CN109521578B (en) * | 2017-09-19 | 2021-02-26 | 奥比中光科技集团股份有限公司 | Depth camera |
JP6979617B2 (en) * | 2017-09-29 | 2021-12-15 | パナソニックIpマネジメント株式会社 | Brightness adjustment system, display system, moving object, and program |
US10731976B2 (en) * | 2017-10-02 | 2020-08-04 | Liqxtal Technology Inc. | Optical sensing device and structured light projector |
EP3692396A4 (en) * | 2017-10-08 | 2021-07-21 | Magik Eye Inc. | Distance measurement using a longitudinal grid pattern |
KR102457891B1 (en) * | 2017-10-30 | 2022-10-25 | 삼성전자주식회사 | Method and apparatus for image processing |
US10334232B2 (en) * | 2017-11-13 | 2019-06-25 | Himax Technologies Limited | Depth-sensing device and depth-sensing method |
EP3486606A1 (en) * | 2017-11-20 | 2019-05-22 | Leica Geosystems AG | Stereo camera and stereophotogrammetric method |
JP6970376B2 (en) * | 2017-12-01 | 2021-11-24 | オムロン株式会社 | Image processing system and image processing method |
CN108122254B (en) * | 2017-12-15 | 2021-06-22 | 中国科学院深圳先进技术研究院 | Three-dimensional image reconstruction method and device based on structured light and storage medium |
US10895752B1 (en) * | 2018-01-10 | 2021-01-19 | Facebook Technologies, Llc | Diffractive optical elements (DOEs) for high tolerance of structured light |
US11852843B1 (en) | 2018-01-10 | 2023-12-26 | Meta Platforms Technologies, Llc | Diffractive optical elements (DOEs) for high tolerance of structured light |
CN108337492B (en) * | 2018-01-15 | 2020-04-17 | 深圳奥比中光科技有限公司 | Dynamic projection imaging device |
CN108335335B (en) * | 2018-02-11 | 2019-06-21 | 北京大学深圳研究生院 | A kind of point cloud genera compression method based on enhancing figure transformation |
JP6880512B2 (en) | 2018-02-14 | 2021-06-02 | オムロン株式会社 | 3D measuring device, 3D measuring method and 3D measuring program |
US10802291B1 (en) * | 2018-03-21 | 2020-10-13 | Apple Inc. | Folded projection system |
CN108594454B (en) | 2018-03-23 | 2019-12-13 | 深圳奥比中光科技有限公司 | Structured light projection module and depth camera |
JP7446234B2 (en) * | 2018-04-11 | 2024-03-08 | インターデジタル ヴイシー ホールディングス, インコーポレイテッド | Method for encoding depth values of a set of 3D points once orthogonally projected onto at least one image region of a projection plane |
US10529128B1 (en) * | 2018-04-27 | 2020-01-07 | Facebook Technologies, Llc | Apparatus, system, and method for mapping a 3D environment |
EP3803266A4 (en) * | 2018-06-06 | 2022-03-09 | Magik Eye Inc. | Distance measurement using high density projection patterns |
US10885648B2 (en) | 2018-07-20 | 2021-01-05 | Samsung Electronics Co., Ltd. | Method of reconstructing three dimensional image using structured light pattern system |
CN109141289B (en) * | 2018-08-01 | 2020-12-29 | 先临三维科技股份有限公司 | Three-dimensional scanning method and system |
EP3824339A4 (en) * | 2018-08-24 | 2021-09-29 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Infrared projector, imaging device, and terminal device |
US10909373B1 (en) * | 2018-08-24 | 2021-02-02 | Snap Inc. | Augmented reality system using structured light |
US10915003B2 (en) * | 2018-09-27 | 2021-02-09 | Himax Technologies Limited | Projecting apparatus for 3D sensing system |
US10977775B2 (en) * | 2018-12-07 | 2021-04-13 | Himax Technologies Limited | Depth decoding system and method for ground truth image rectification |
KR102645539B1 (en) * | 2019-01-18 | 2024-03-11 | 삼성전자주식회사 | Apparatus and method for encoding in a structured depth camera system |
WO2020150131A1 (en) | 2019-01-20 | 2020-07-23 | Magik Eye Inc. | Three-dimensional sensor including bandpass filter having multiple passbands |
US20200240769A1 (en) * | 2019-01-25 | 2020-07-30 | Cam4D Ltd. | Depth and spectral measurement with wavelength-encoded light pattern |
KR20200110172A (en) * | 2019-03-15 | 2020-09-23 | 엘지전자 주식회사 | Optical device, camera device, and electronic apparatus including the same |
US11474209B2 (en) | 2019-03-25 | 2022-10-18 | Magik Eye Inc. | Distance measurement using high density projection patterns |
US10805549B1 (en) * | 2019-08-20 | 2020-10-13 | Himax Technologies Limited | Method and apparatus of auto exposure control based on pattern detection in depth sensing system |
US11450083B2 (en) * | 2019-09-27 | 2022-09-20 | Honeywell International Inc. | Dual-pattern optical 3D dimensioning |
US11639846B2 (en) | 2019-09-27 | 2023-05-02 | Honeywell International Inc. | Dual-pattern optical 3D dimensioning |
CN113168019B (en) * | 2019-10-18 | 2023-11-03 | 谷歌有限责任公司 | Diffractive optical element for large-field imaging |
KR102248248B1 (en) * | 2019-11-06 | 2021-05-04 | 주식회사 메디트 | Projection Optical System for Obtaining 3 Dimensional data using Structured Light Pattern |
CN114730010A (en) | 2019-12-01 | 2022-07-08 | 魔眼公司 | Enhancing triangulation-based three-dimensional distance measurements using time-of-flight information |
US11580654B2 (en) * | 2019-12-30 | 2023-02-14 | Qualcomm Incorporated | Alternating light distributions for active depth sensing |
GB2595850A (en) * | 2020-06-02 | 2021-12-15 | Sepha Ltd | Leak detection system and method |
KR20220047035A (en) | 2020-10-08 | 2022-04-15 | 삼성전자주식회사 | Device and method for measuring depth of object |
JP2023024054A (en) * | 2021-08-06 | 2023-02-16 | 株式会社小糸製作所 | Image display device and image display method |
WO2023085329A1 (en) * | 2021-11-12 | 2023-05-19 | 株式会社小糸製作所 | Imaging system, sensor unit, vehicle lamp fitting, and vehicle |
CN114937123B (en) * | 2022-07-19 | 2022-11-04 | 南京邮电大学 | Building modeling method and device based on multi-source image fusion |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4558952A (en) * | 1983-02-22 | 1985-12-17 | Kules Vladimir P | Method for measuring an optical length of light path and a laser interferometer for carrying same into effect |
US5994709A (en) * | 1997-03-14 | 1999-11-30 | Nikon Corporation | Charged-particle-beam exposure apparatus exhibiting aberration control |
US20110063622A1 (en) * | 2009-09-11 | 2011-03-17 | Canon Kabushiki Kaisha | Optical encoder for obtaining displacement information of object |
US20150300816A1 (en) * | 2012-10-29 | 2015-10-22 | 7D Surgical Inc. | Integrated illumination and optical surface topology detection system and methods of use thereof |
US20150355470A1 (en) * | 2012-12-31 | 2015-12-10 | Iee International Electronics & Engineering S.A. | Optical system generating a structured light field from an array of light sources by means of a refracting or reflecting light structuring element |
US20160248953A1 (en) * | 2014-01-08 | 2016-08-25 | Mitsubishi Electric Corporation | Image generation device |
Family Cites Families (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4175862A (en) * | 1975-08-27 | 1979-11-27 | Solid Photography Inc. | Arrangement for sensing the geometric characteristics of an object |
DE2716095A1 (en) | 1977-04-12 | 1978-10-19 | Zoeld Tibor Dr Phys | GAS CONTROLLED PROCESS FOR SORTING PARTICLES SUSPENDED IN AN ELECTROLYTE AND DEVICE FOR CARRYING OUT THE PROCESS |
US7194117B2 (en) * | 1999-06-29 | 2007-03-20 | The Research Foundation Of State University Of New York | System and method for performing a three-dimensional virtual examination of objects, such as internal organs |
US6961200B2 (en) * | 1999-07-27 | 2005-11-01 | Quantum Corporation | Optical servo track identification on tape storage media |
US7031366B2 (en) * | 2003-08-29 | 2006-04-18 | Agilent Technologies, Inc. | Using relay lens to enhance optical performance of an external cavity laser |
IL172240A0 (en) * | 2005-11-29 | 2006-04-10 | Elta Systems Ltd | Cooling system for semiconductor lasers |
EP1994503B1 (en) | 2006-03-14 | 2017-07-05 | Apple Inc. | Depth-varying light fields for three dimensional sensing |
CN100449258C (en) * | 2006-04-27 | 2009-01-07 | 浙江工业大学 | Real time three-dimensional vision system based on two-dimension colorama encoding |
JP4990275B2 (en) * | 2006-05-18 | 2012-08-01 | パナソニック株式会社 | Planar light source device and liquid crystal display device |
CA2670214A1 (en) | 2006-11-21 | 2008-05-29 | Mantisvision Ltd. | 3d geometric modeling and 3d video content creation |
US8090194B2 (en) * | 2006-11-21 | 2012-01-03 | Mantis Vision Ltd. | 3D geometric modeling and motion capture using both single and dual imaging |
JP4818091B2 (en) * | 2006-12-13 | 2011-11-16 | キヤノン株式会社 | Information processing apparatus, image processing apparatus, control method for information processing apparatus, and control method for image processing apparatus |
US7768656B2 (en) * | 2007-08-28 | 2010-08-03 | Artec Group, Inc. | System and method for three-dimensional measurement of the shape of material objects |
US8411137B2 (en) * | 2008-07-16 | 2013-04-02 | Dolby Laboratories Licensing Corporation | Dual projection system with inversely synchronized channel projections |
CN102203551B (en) * | 2008-10-06 | 2015-02-11 | 曼蒂斯影像有限公司 | Method and system for providing three-dimensional and range inter-planar estimation |
US8215776B2 (en) * | 2009-01-07 | 2012-07-10 | Eastman Kodak Company | Line illumination apparatus using laser arrays |
US20100238270A1 (en) * | 2009-03-20 | 2010-09-23 | Intrepid Management Group, Inc. | Endoscopic apparatus and method for producing via a holographic optical element an autostereoscopic 3-d image |
CN101608906B (en) * | 2009-07-21 | 2012-01-04 | 西安交通大学 | Method for measuring optical three-dimensional contour of space coding |
US8749796B2 (en) * | 2011-08-09 | 2014-06-10 | Primesense Ltd. | Projectors of structured light |
US20130135588A1 (en) * | 2011-11-29 | 2013-05-30 | Milan Momcilo Popovich | 3D display apparatus |
US8630481B2 (en) * | 2011-12-20 | 2014-01-14 | Eastman Kodak Company | Encoding information in illumination patterns |
US8864314B2 (en) * | 2012-01-17 | 2014-10-21 | Eastman Kodak Company | Stereoscopic projection system using tunable light emitters |
CN107806826B (en) * | 2012-03-26 | 2021-10-26 | 螳螂慧视科技有限公司 | Three-dimensional camera and projector thereof |
US20140028801A1 (en) * | 2012-07-30 | 2014-01-30 | Canon Kabushiki Kaisha | Multispectral Binary Coded Projection |
US10785463B2 (en) * | 2013-07-16 | 2020-09-22 | Texas Instruments Incorporated | Super-resolution in structured light imaging |
WO2016024200A2 (en) | 2014-08-12 | 2016-02-18 | Mantisvision Ltd. | Structured light projection and imaging |
-
2015
- 2015-08-10 WO PCT/IB2015/056074 patent/WO2016024200A2/en active Application Filing
- 2015-08-10 WO PCT/IB2015/056078 patent/WO2016024203A2/en active Application Filing
- 2015-08-10 CN CN201580054465.8A patent/CN106796661B/en active Active
- 2015-08-11 US US14/822,961 patent/US9915827B2/en active Active
- 2015-08-11 US US14/823,008 patent/US10409083B2/en not_active Expired - Fee Related
-
2018
- 2018-03-08 US US15/915,104 patent/US10768435B2/en active Active
-
2019
- 2019-08-07 US US16/535,024 patent/US20190361258A1/en not_active Abandoned
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4558952A (en) * | 1983-02-22 | 1985-12-17 | Kules Vladimir P | Method for measuring an optical length of light path and a laser interferometer for carrying same into effect |
US5994709A (en) * | 1997-03-14 | 1999-11-30 | Nikon Corporation | Charged-particle-beam exposure apparatus exhibiting aberration control |
US20110063622A1 (en) * | 2009-09-11 | 2011-03-17 | Canon Kabushiki Kaisha | Optical encoder for obtaining displacement information of object |
US20150300816A1 (en) * | 2012-10-29 | 2015-10-22 | 7D Surgical Inc. | Integrated illumination and optical surface topology detection system and methods of use thereof |
US20150355470A1 (en) * | 2012-12-31 | 2015-12-10 | Iee International Electronics & Engineering S.A. | Optical system generating a structured light field from an array of light sources by means of a refracting or reflecting light structuring element |
US20160248953A1 (en) * | 2014-01-08 | 2016-08-25 | Mitsubishi Electric Corporation | Image generation device |
Also Published As
Publication number | Publication date |
---|---|
WO2016024200A3 (en) | 2016-06-09 |
US20160050401A1 (en) | 2016-02-18 |
US9915827B2 (en) | 2018-03-13 |
CN106796661B (en) | 2020-08-25 |
US20160223828A1 (en) | 2016-08-04 |
US20190011721A1 (en) | 2019-01-10 |
WO2016024200A2 (en) | 2016-02-18 |
US10409083B2 (en) | 2019-09-10 |
WO2016024203A3 (en) | 2016-04-28 |
WO2016024203A2 (en) | 2016-02-18 |
CN106796661A (en) | 2017-05-31 |
US10768435B2 (en) | 2020-09-08 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190361258A1 (en) | Structured light projection and imaging | |
US10228243B2 (en) | Distance sensor with parallel projection beams | |
CN110234955B (en) | Distance sensor for projecting parallel patterns | |
US9142025B2 (en) | Method and apparatus for obtaining depth information using optical pattern | |
US10488192B2 (en) | Distance sensor projecting parallel patterns | |
US10268906B2 (en) | Distance sensor with directional projection beams | |
KR101605224B1 (en) | Method and apparatus for obtaining depth information using optical pattern | |
US10571668B2 (en) | Catadioptric projector systems, devices, and methods | |
KR101858491B1 (en) | 3-d image analyzer for determining viewing direction | |
EP2831538B1 (en) | Three dimensional camera and projector for same | |
US10440349B2 (en) | 3-D 360 degrees depth projector | |
US20140028799A1 (en) | Use of Color and Intensity Modulation of a Display for Three-Dimensional Object Information | |
WO2020117785A1 (en) | Vertical cavity surface emitting laser-based projector | |
US10877622B2 (en) | Detection of structured light for depth sensing | |
JP2022511257A (en) | Depth detection using lattice light pattern | |
US11158074B1 (en) | Depth sensing using temporal coding | |
EP3664447A1 (en) | Structured light projector, three-dimensional camera module and terminal device | |
US11592572B2 (en) | Depth sensing using dynamic illumination with range extension | |
JP2015184056A (en) | Measurement device, method, and program | |
US9280829B1 (en) | Using linear functions to calculate depth information for scenes illuminated with structured light | |
EP3462128B1 (en) | 3d 360-degree camera system | |
TWM486066U (en) | Structured light element and light source module therewith | |
JP6626552B1 (en) | Multi-image projector and electronic device having multi-image projector | |
TWI719383B (en) | Multi-image projector and electronic device having multi-image projector | |
CN112912929A (en) | Fisheye infrared depth detection |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |