WO2017040066A1 - Range-finder apparatus, methods, and applications - Google Patents

Range-finder apparatus, methods, and applications Download PDF

Info

Publication number
WO2017040066A1
WO2017040066A1 PCT/US2016/047767 US2016047767W WO2017040066A1 WO 2017040066 A1 WO2017040066 A1 WO 2017040066A1 US 2016047767 W US2016047767 W US 2016047767W WO 2017040066 A1 WO2017040066 A1 WO 2017040066A1
Authority
WO
WIPO (PCT)
Prior art keywords
light modulator
objective lens
scanning device
pixelated light
detector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2016/047767
Other languages
French (fr)
Inventor
Yuzuru Takashima
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Arizona
Arizona's Public Universities
Original Assignee
University of Arizona
Arizona's Public Universities
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Arizona, Arizona's Public Universities filed Critical University of Arizona
Priority to US15/756,290 priority Critical patent/US10281262B2/en
Publication of WO2017040066A1 publication Critical patent/WO2017040066A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/14Measuring arrangements characterised by the use of optical techniques for measuring distance or clearance between spaced objects or spaced apertures
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/22Measuring arrangements characterised by the use of optical techniques for measuring depth
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C3/00Measuring distances in line of sight; Optical rangefinders
    • G01C3/02Details
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/42Simultaneous measurement of distance and other co-ordinates
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/89Lidar systems specially adapted for specific applications for mapping or imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/93Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481Constructional features, e.g. arrangements of optical elements
    • G01S7/4814Constructional features, e.g. arrangements of optical elements of transmitters alone
    • G01S7/4815Constructional features, e.g. arrangements of optical elements of transmitters alone using multiple transmitters
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481Constructional features, e.g. arrangements of optical elements
    • G01S7/4817Constructional features, e.g. arrangements of optical elements relating to scanning

Definitions

  • Range-finder Apparatus Apparatus, Methods, and Applications
  • aspects and embodiments of the invention are directed to range-finding apparatus, methods, and applications thereof. More particularly, aspects and embodiments are directed to lidar and optical scanning apparatus, methods, and applications and, most particularly to range-finder apparatus having a wide field of view, associated methods, and applications thereof.
  • Mapping the distance to objects by measuring a time of flight has become one of the main sensing schemes for the purpose of improving the safety of automotive transportation and autonomously driven vehicles.
  • Distances to objects such as cars, pedestrians, and obstacles may be measured, for example, over a 360 degree field of view with sub one (1) degree resolution and a 10 fps frame rate by launching a nano-second pulse from a laser toward an object.
  • the reflected light from the object is detected by a detector, comprising for example, a silicon photo diode or an avalanche photo diode (APD).
  • the distance between the light source and the object is measured by detecting the delay between the launching of the pulse by the laser and the arrival of the echo at the detector.
  • Such a distance measurement system used along with object recognition can be used to reduce the probability of car accidents.
  • autonomous driving requires some range finding mechanism such as laser range finding.
  • Laser range finding is also of interest for consumer applications, such as robot cleaners and others. Mapping of objects in a room, for example, by a distance measurement increases the area throughout the room that can be cleaned by providing additional information to the existing routing algorithm.
  • a new generation of Lidar systems with high resolution, high ranging accurate, and high frame rate is heading toward the direction of miniaturization, light weight, portability, and low cost and has been applied widely in the civilian and military fields such as laser ranging, topography, architectural drawing, environmental monitoring, vehicle driving navigation, unmanned ground vehicle navigation, etc.
  • a resonant scanner can be considered one of the important components because of its huge advantages, including fast scanning speed, flexibility, low power consumption, etc.
  • the mechanical tilt angle of a resonant scanner with a small aperture of 10 mm x 6 mm has a maximum optical full scan angle of only about 50°, which is simply not enough for a Lidar system for autonomous applications.
  • a light detection and ranging (lidar) system is currently relatively expensive.
  • a Lidar system currently offered by Verodyne has been found to cost about $80,000.
  • the system employs conventional mechanical scanning; that is, both the laser sources and the detectors are mounted on a rotating mechanical mount. Pulsed light from the laser is collimated by a lens and directed toward an object, and an echo of the pulse coming off the object is captured by detector optics and focused on the detector, while the entire optical setup is rotating at a high speed.
  • This mechanical scanning approach is believed to be the most effective mechanical scanning approach currently available. Since the light is collimated, the laser power density at the object is high, thus the reflected signal can be detected with a high signal-to-noise ratio (S R).
  • S R signal-to-noise ratio
  • non-mechanical scanning is ideal to avoid failure of the scanning mechanism carrying the transmitter and the receiver.
  • a rotating polygon mirror may be used to scan a laser across a scene, or a flood illumination array of laser diodes (LDs) or light emitting diodes (LEDs) can provide non- mechanical scanning.
  • LDs laser diodes
  • LEDs light emitting diodes
  • receiver optics there is no viable solution available to map distance and angular position of an object other than low resolution avalanche photo diode (APD) arrays whose resolution is very low compared to the desired specifications of 10 fps, 360 degree FOV, and sub one (1) degree resolution.
  • APD avalanche photo diode
  • the scanning device includes an objective lens having an optical axis, a controllable pixelated light modulator disposed along the optical axis on an image side of the objective lens and having a plurality of individual pixel elements and a lateral dimension, wherein a direct field of view of the optical scanning device is set by said lateral dimension, a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, wherein an extended field of view is set by said pair of reflective surfaces such that a point outside of the direct field of view on an object side of the objective lens is mapped to a respective pixel of the pixelated light modulator, a controller coupled to the pixelated light modulator in a manner to selectively control any of a plurality of selected arrangements of the pixel elements so as to map a point from either the direct field of view or the
  • the optical scanning device may include some or all of the following features, components, steps, limitations, and/or characteristics, alone or in non- limiting variations appreciated by those skilled in the art:
  • pair of lateral reflective surfaces have respective substantially-flat reflective surfaces that are disposed substantially parallel to one another;
  • each one of the pair of lateral reflective surfaces are tilted from between zero to 10 degrees;
  • controllable pixelated light modulator is a digital micromirror device (DMD); -wherein the controllable pixelated light modulator is a liquid crystal display (LCD);
  • DMD digital micromirror device
  • LCD liquid crystal display
  • controllable pixelated light modulator is a grating light valve (GLV);
  • -further comprising a one dimensional focusing element disposed so as to focus tangential rays reflected from the pixelated light modulator;
  • the one dimensional focusing element is a cylindrical lens
  • -further comprising an array of roof mirrors disposed between the pixelated light modulator and the detector, wherein sagittal light rays from the pixelated light modulator are guided to the detector;
  • -further comprising an optical path selector disposed between the objective lens and the micro-mirror array to map individual micro-mirrors both to a corresponding point in front of the objective lens and to the single point in back of the objective lens;
  • optical path selector is a beam splitter; -wherein the optical path selector is a frustrated total internal reflection prism;
  • a scanner illumination source modulator adapted to modulate the scanner illumination and a demodulator coupled to the detector to demodulate the light directed to the detector by the pixelated light modulator wherein a transit delay of a modulation envelope from the illumination source to the detector can be used to determine a distance of the scanning device from an illuminated object.
  • the laser range finder includes an objective lens having an optical axis, an object side, and an image side, a controllable pixelated light modulator disposed along the optical axis on the image side of the lens, and a detector disposed optically downstream from the pixelated light modulator on the image side of the lens.
  • the optical scanning device may include some or all of the following features, components, steps, limitations, and/or characteristics, alone or in non-limiting variations appreciated by those skilled in the art:
  • the pixelated light modulator has a lateral dimension that determines a direct object side field of view (FOV) of the laser range finder;
  • -further comprising a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, wherein at least one of a shape, a position, an orientation, and a dimension of which establish an indirect FOV of the laser range finder;
  • controllable pixelated light modulator is a digital micromirror device (DMD); -wherein the controllable pixelated light modulator is a liquid crystal display (LCD);
  • DMD digital micromirror device
  • LCD liquid crystal display
  • the controllable pixelated light modulator is a grating light valve (GLV).
  • An aspect of the invention is an optical scanning method.
  • the optical scanning method includes the steps of providing a controllable pixelated light modulator having a plurality of individual pixel elements and a lateral dimension that determines a direct object side scanning field, providing a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted in a sagittal plane, imaging light from one or more points in the object side scanning field onto the pixelated light modulator by reflection from the pair of reflective surfaces, the shape, position and dimensions of which establish an indirect scanning field, and selectively controlling any of a plurality of selected arrangements of the pixel elements so as to map one or more points in the direct scanning field and the indirect scanning field to a single point in an image side a detection field.
  • the optical scanning method may include some
  • -further comprising illuminating the one or more points in the object side of the objective lens with light so as to cause light to be emitted from those points and received at the single point on the image side of the objective lens;
  • -further comprising modulating the illuminating light, demodulating the light received at the single point on the image side of the objective lens, and determining a transit delay of the modulation envelope from the source of light to a detector to determine the distance of the scanning device to one or more of the points in the object side of the objective lens.
  • Fig. 1 A is a schematic block circuit layout of a pixelated light modulator (e.g., DMD, LCD, GLV (grating light valve)-based imaging Lidar system
  • Fig. IB is a schematic block circuit procedure of operation of a pixelated light modulator-based imaging Lidar system, according to illustrative embodiments of the invention.
  • a pixelated light modulator e.g., DMD, LCD, GLV (grating light valve)-based imaging Lidar system
  • Fig. IB is a schematic block circuit procedure of operation of a pixelated light modulator-based imaging Lidar system, according to illustrative embodiments of the invention.
  • Fig. 2(a) is a schematic side-view line drawing of a Lidar transmitter portion
  • Fig. 2(b) is a schematic top view line drawing of a DMD-based Lidar receiver portion
  • Fig. 2(c) is a schematic side view line drawing of a DMD-based Lidar receiver portion, according to illustrative embodiments of the invention.
  • Fig. 3(a) is a schematic top view of a DMD-based Lidar receiver portion having an increased field-of-view (FOV)
  • Fig. 3(b) is a schematic side view seen from positive z-axis of mirror components of the receiver portion shown in Fig. 3(a)
  • Fig. 3(c) is a schematic side- view of the receiver portion shown in Fig. 3(a), according to illustrative embodiments of the invention.
  • Fig. 4(a) is a schematic perspective view ray trace diagram illustrating the imaging of the tangential rays by the DMD-based Lidar receiver portion
  • Fig. 4(b) is a schematic side view of ray trace diagram illustrating the imaging of the tangential rays by the DMD-based Lidar receiver portion, according to illustrative embodiments of the invention.
  • Fig. 5(a) is a schematic top view of a DMD-based Lidar receiver portion showing representative field points in a horizontal plane
  • Fig. 5(b) is a schematic side view of a DMD- based Lidar receiver portion showing representative field points in a vertical plane, according to illustrative embodiments of the invention.
  • Fig. 6(a), Fig. 6(b), and Fig. 6(c), respectively, diagrammatically illustrate image locations on the DMD for different FOVs, according to illustrative embodiments of the invention.
  • Fig. 7 diagrammatically illustrates overlapping image locations in the DMD plane, according to an illustrative embodiment of the invention.
  • Fig. 8(a), Fig. 8(b), and Fig. 8(c) illustrate alternative principles of recovering the one- to-one mapping between horizontal and vertical FOVs to the intermediate image location on the DMD, according to illustrative embodiments of the invention.
  • Fig. 9 is a schematic box diagram illustrating control and measurement by a Lidar system, according to an illustrative embodiment of the invention.
  • Fig. 1 A is a schematic block circuit layout of a pixelated light modulator (e.g., DMD, LCD, GLV (grating light valve)-based imaging Lidar system.
  • Fig. IB is a schematic block circuit procedure of operation of a pixelated light modulator-based imaging Lidar system.
  • DMD digital micromirror device
  • the term DMD will be used hereinafter in describing all embodiments as a matter of convenience.
  • the microcontroller e.g., iOS
  • the microcontroller triggers a 905 nm laser pulse and also starts a timer in the Time-to-Digital Converter (TDC) Integrated Circuit (IC).
  • the laser pulse is propagated through the transmission optics, reflected by the target field, spatially filtered by the DMD, and captured by an avalanche photodiode (APD).
  • the APD emits a short (20 ns, 100 mV) electrical pulse which is then amplified by an electrical signal amplifier.
  • a comparator IC recognizes the pulse and sends a digital signal (3 V) to the TDC to stop the timer.
  • the TDC uses an 8.196 MHz clock to calibrate each measurement.
  • the TDC sends the serial data of the differential time, in nanoseconds, between the start and stop digital signals to the microcontroller, which filters out the error reads, averages multiple time measurements, and calculates the distance to the target at that particular field position.
  • the microcontroller then increments the DMD pattern to test a new field location before restarting the distance measurements.
  • the embodied invention enables high resolution, wide FOV, non-mechanical scanning of receiver optics by using microelectromechanical (MEMS)- based optical devices such as a DMD.
  • MEMS microelectromechanical
  • Fig. 2a illustrates a LIDAR transmitter portion of the system.
  • Pulsed and/or modulated laser- or LED-sourced light is emitted by a scanning laser device such as conventional rotating polygon mirror or, alternatively as shown, by an array of laser diodes (LDs) or light emitting diodes (LEDs) 10, which provide non-mechanical illumination of an object or target scene.
  • the target field is flood illuminated or partially flood illuminated by the array of light sources.
  • a scanning lens 12 causes the beam to be collimated or slightly diverging to cover the field of view of the receiving optics.
  • a receiving portion comprises an imaging lens 14, a DMD 16, a beam splitter, such as a frustrated total internal reflection (FTIR) prism 18, detection optics 20, and photo detector 22.
  • the entire field of view (FOV) from the target or object side is imaged by the imaging lens 14.
  • the objects illuminated within the FOV are imaged onto the DMD device 16 by imaging lens 14.
  • the DMD device selectively reflects the light from the illuminated object field towards detection optics 20. For example, a single DMD pixel may be partially actuated while the remaining pixels are all turned off.
  • the deflected beam is routed toward the photo detector 22 by a FTIR prism 18 to minimize loss, or alternatively by a beam splitter.
  • the detection optics 20 delivers light to the photo detector 22.
  • the angular resolution, ⁇ , in units of radians is given by d/f, where d is the pitch of the DMD device.
  • d is the pitch of the DMD device.
  • the pixel pitch, d is on the order of 5-20 micrometer, whereas the focal length, of the imaging lens is on the order of 1-100 mm.
  • is 1E-2 to 1E-4 radians, which corresponds to 0.573 and 0.00573 degrees, respectively.
  • the full field of view of the passive LIDAR device is limited by the horizontal (x-z plane) extent, L, of DMD 14 and the focal length, of the imaging optics and is given by 2 tan _1 (L/2 ) for a well-corrected imaging system. Similar to the conventional imaging optics, there is a trade-off between the angular resolution and full FOV. For example, longer focal length provides a higher angular resolution; however, the full FOV becomes smaller.
  • a pair of lateral reflectors such as mirrors 24 and 26, whose reflecting surfaces are advantageously parallel and facing each other.
  • the pair of reflectors 24, 26 are located along the optical axis 28 of the imaging optics.
  • the respective surface normals of the pair of mirrors are tilted to the horizontal (x-z) scanning (sagittal) plane of the imaging optics between 1-10 degrees. Since the chief ray angle, ⁇ , with respect to the optical axis has to be a finite value, the pair of mirrors remaps the horizontal scanning angle to the DMD plane in a folded and tilted manner.
  • Fig. 3 c schematically depicts the effect of the functionality of the pair of mirrors. The implementation is effective especially for Lidar for automotive applications, since the full vertical FOV is relatively small (10-20 degrees) compared to the horizontal FOV (60-180) degrees.
  • Figs. 4(a,b) illustrate the receiver/detection optics portion of the system.
  • a linear array 30 of retro-reflectors such as, e.g., roof mirrors or roof mirror prisms.
  • An object field/target is imaged by lens 14 on to the DMD 28.
  • the image formed on the DMD is an intermediate image.
  • the intermediate image is re-imaged onto a photo detector 22 by a cylindrical lens 34 as shown by tangential rays 36 (rays 40 are sagittal rays).
  • the cylindrical lens images the tangential rays from the intermediate image on the DMD to the detector 22 by reflection from one of the roof mirrors.
  • the nominal plane of the retroreflector array 30 is oriented with respect to the nominal plane of the DMD 28 and the detector 22 so that the diverging sagittal rays 40 from the DMD are reflected by the retroreflector towards and converge upon the detector 22.
  • the surface normal of the retroreflector array is tilted in the tangential plane so that the final image is displaced with respect to the DMD to accommodate the detector 22.
  • the intermediate image is re-imaged to detector 22 by two different means for the tangential and sagittal rays, respectively.
  • the size of detector 22 in the tangential direction is determined by magnification of the cylindrical lens 34.
  • the size of the detector 22 is identical to the lateral dimension of the DMD since the linear roof mirror array 30 has unit magnification.
  • additional lens units 29 in front of the detector may be inserted when matching the size of the detector to DMD is desired.
  • the pair of reflectors 24, 26 located along the optical axis 28 of the imaging optics provide an increased indirect FOV of the system.
  • the structure and operation of the lateral mirrors 24 and 26 for expanding the lateral field of view is further explained with respect to Figs. 5-8.
  • FIGs. 5a, 5b respectively, representative field points in the horizontal (x- z plane) direction (H-2, H-l, H-0, H+l, and H+2) as well as in the vertical (y-z plane) direction (V-l, V-0, V+l) are depicted.
  • Figs. 6(a, b, c) image locations on the DMD are depicted as black circles for each FOV.
  • image locations for H-2, H-l, H-0, H+l, and H+2 with the V-0 vertical field are depicted as image points 1-2, 1-1, 1-0, 1+1, 1+2, respectively, and similarly for the H z n points for V-l and V+l in Figs. 6(a) and 6(b), respectively.
  • the light captured within the (direct) field of view H-l to H+l is not reflected by the parallel mirrors, and goes straight to the DMD.
  • light from an object outside of the H+l and H-l field i.e., extended FOV
  • Fig. 7 While increasing the FOV, the trajectory of the image location on the DMD forms a zig-zag line pattern as depicted in Fig. 7.
  • Figs. 6a, 6b, and 6c depict the trajectory of image locations for vertical fields of view, V-l, V-0, and V+l .
  • the zigzag pattern remains the same as the vertical field of view, whereas mutual shifts along the y-direction among the patterns are induced by the vertical field of view.
  • the zigzag pattern remains the same for V-l, V-0, and V+l, but shifts progressively along the y-direction, such that the individual patterns overlap each other.
  • the overlapped zigzag patterns effectively fill the DMD plane.
  • one-to-one mapping between the object and DMD is not maintained specifically at the points where each of the zig-zag patterns overlap each other, as shown in Fig. 7.
  • the problem can be solved by using slice illumination and/or applying an orthogonal light modulation code among each vertical field of view.
  • Figs. 8(a,b,c) show the principle of recovering the one-to-one mapping between horizontal and vertical fields of view to the intermediate image location on the DMD device.
  • the light transmitter consists of an array of light sources. Each light source is a collimated light source scanning a horizontal FOV or a light source collimated in the tangential (vertical) plane and converging or diverging in the sagittal (horizontal) plane. In either implementation, each light source covers only a limited portion of the vertical FOV.
  • the transmitter Upon scanning the vertical and horizontal fields of view, the transmitter selectively turns on the illuminating light by which the vertical FOV is selected by the transmitter.
  • a portion of the DMD mirror is selectively turned on to select the horizontal FOV.
  • each of the light transmitters is modulated in an orthogonal manner.
  • Lidar may be implemented by a control and measurement system as shown in Fig. 9.
  • a controller activates the laser diode of the array to select the vertical FOV.
  • the laser diodes are turned on by a timing pulse created by the controller.
  • the wave shape of the resulting laser pulse advantageously is Gaussian for a time-of-flight based distance measurement.
  • a modulated pulse shape may be used.
  • the controller drives the DMD to select the horizontal FOV by turning on the corresponding pixel(s).
  • the reflected laser light from an object is detected by the detector.
  • the detected signal is compared with the timing pulse. For time of flight measurement, the delay of the detected pulse with respect to the timing pulse is measured.
  • a correlation operation as a function of delay time measured with respect to the timing pulse is carried out for the modulated pulse shape.
  • the time delay provides distance information for the vertical FOV by selection of the illumination source, and selection of the pixel(s) of the DMD.
  • the horizontal scanning operation is repeated for the full vertical and horizontal FOVs of the system.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Electromagnetism (AREA)
  • Optical Radar Systems And Details Thereof (AREA)

Abstract

An imaging laser range finder including an objective lens having an optical axis, an object side, and an image side, a controllable pixelated light modulator disposed along the optical axis on the image side of the lens, and a detector disposed optically downstream from the pixelated light modulator on the image side of the lens. The controllable pixelated light modulator is advantageously a MEMS-based system such as a digital mirror device (DMD). An increased field of view may be obtained by incorporating a pair of opposing surface reflectors between an imaging lens and the controllable pixelated light modulator. Associated methods are disclosed.

Description

Range-finder Apparatus, Methods, and Applications
Related Application Data
The instant application claims priority to US provisional application 62/212,525 filed on 08/31/2015, the subject matter of which is incorporated by reference herein in its entirety.
Background
Aspects and embodiments of the invention are directed to range-finding apparatus, methods, and applications thereof. More particularly, aspects and embodiments are directed to lidar and optical scanning apparatus, methods, and applications and, most particularly to range-finder apparatus having a wide field of view, associated methods, and applications thereof.
Mapping the distance to objects by measuring a time of flight has become one of the main sensing schemes for the purpose of improving the safety of automotive transportation and autonomously driven vehicles. Distances to objects, such as cars, pedestrians, and obstacles may be measured, for example, over a 360 degree field of view with sub one (1) degree resolution and a 10 fps frame rate by launching a nano-second pulse from a laser toward an object. The reflected light from the object is detected by a detector, comprising for example, a silicon photo diode or an avalanche photo diode (APD). The distance between the light source and the object is measured by detecting the delay between the launching of the pulse by the laser and the arrival of the echo at the detector. Such a distance measurement system used along with object recognition can be used to reduce the probability of car accidents.
Also, autonomous driving requires some range finding mechanism such as laser range finding. Laser range finding is also of interest for consumer applications, such as robot cleaners and others. Mapping of objects in a room, for example, by a distance measurement increases the area throughout the room that can be cleaned by providing additional information to the existing routing algorithm.
A new generation of Lidar systems with high resolution, high ranging accurate, and high frame rate is heading toward the direction of miniaturization, light weight, portability, and low cost and has been applied widely in the civilian and military fields such as laser ranging, topography, architectural drawing, environmental monitoring, vehicle driving navigation, unmanned ground vehicle navigation, etc. In Lidar systems, a resonant scanner can be considered one of the important components because of its huge advantages, including fast scanning speed, flexibility, low power consumption, etc. However, the mechanical tilt angle of a resonant scanner with a small aperture of 10 mm x 6 mm has a maximum optical full scan angle of only about 50°, which is simply not enough for a Lidar system for autonomous applications.
For automotive applications, a light detection and ranging (lidar) system is currently relatively expensive. For example a Lidar system currently offered by Verodyne has been found to cost about $80,000. The system employs conventional mechanical scanning; that is, both the laser sources and the detectors are mounted on a rotating mechanical mount. Pulsed light from the laser is collimated by a lens and directed toward an object, and an echo of the pulse coming off the object is captured by detector optics and focused on the detector, while the entire optical setup is rotating at a high speed. This mechanical scanning approach is believed to be the most effective mechanical scanning approach currently available. Since the light is collimated, the laser power density at the object is high, thus the reflected signal can be detected with a high signal-to-noise ratio (S R).
In low cost car and various consumer applications, non-mechanical scanning is ideal to avoid failure of the scanning mechanism carrying the transmitter and the receiver. For this case, a rotating polygon mirror may be used to scan a laser across a scene, or a flood illumination array of laser diodes (LDs) or light emitting diodes (LEDs) can provide non- mechanical scanning. However for receiver optics, there is no viable solution available to map distance and angular position of an object other than low resolution avalanche photo diode (APD) arrays whose resolution is very low compared to the desired specifications of 10 fps, 360 degree FOV, and sub one (1) degree resolution.
Advantages and benefits over the current state of the art as well as solutions to problems associated with current state of the art apparatus and methods, appreciated by those skilled in the art, would be realized by improved range-finding and scanning apparatus and methods as enabled by the embodiments disclosed and claimed herein, particularly by the elimination of bulky mechanical scanning apparatus, increased field of view, and improved resolution of measurement data.
Summary
An aspect of the invention is an optical scanning device. In a non-limiting exemplary embodiment, the scanning device includes an objective lens having an optical axis, a controllable pixelated light modulator disposed along the optical axis on an image side of the objective lens and having a plurality of individual pixel elements and a lateral dimension, wherein a direct field of view of the optical scanning device is set by said lateral dimension, a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, wherein an extended field of view is set by said pair of reflective surfaces such that a point outside of the direct field of view on an object side of the objective lens is mapped to a respective pixel of the pixelated light modulator, a controller coupled to the pixelated light modulator in a manner to selectively control any of a plurality of selected arrangements of the pixel elements so as to map a point from either the direct field of view or the extended field of view on the object side of the objective lens to a single point on an image side of the objective lens, and a detector disposed so as to produce a signal
representative of the intensity of light emitted from one or more points in front of the objective lens as the controller selectively controls the pixelated light modulator. In various non-limiting, exemplary embodiments the optical scanning device may include some or all of the following features, components, steps, limitations, and/or characteristics, alone or in non- limiting variations appreciated by those skilled in the art:
-wherein the pair of lateral reflective surfaces have respective substantially-flat reflective surfaces that are disposed substantially parallel to one another;
-wherein each one of the pair of lateral reflective surfaces are tilted from between zero to 10 degrees;
-wherein the controllable pixelated light modulator is a digital micromirror device (DMD); -wherein the controllable pixelated light modulator is a liquid crystal display (LCD);
-wherein the controllable pixelated light modulator is a grating light valve (GLV);
-further comprising a one dimensional focusing element disposed so as to focus tangential rays reflected from the pixelated light modulator;
-wherein the one dimensional focusing element is a cylindrical lens;
-further comprising an array of roof mirrors disposed between the pixelated light modulator and the detector, wherein sagittal light rays from the pixelated light modulator are guided to the detector;
-further comprising an optical path selector disposed between the objective lens and the micro-mirror array to map individual micro-mirrors both to a corresponding point in front of the objective lens and to the single point in back of the objective lens;
-wherein the optical path selector is a beam splitter; -wherein the optical path selector is a frustrated total internal reflection prism;
-further comprising a scanner illumination source modulator adapted to modulate the scanner illumination and a demodulator coupled to the detector to demodulate the light directed to the detector by the pixelated light modulator wherein a transit delay of a modulation envelope from the illumination source to the detector can be used to determine a distance of the scanning device from an illuminated object.
An aspect of the invention is a laser range finder. In a non-limiting exemplary embodiment, the laser range finder includes an objective lens having an optical axis, an object side, and an image side, a controllable pixelated light modulator disposed along the optical axis on the image side of the lens, and a detector disposed optically downstream from the pixelated light modulator on the image side of the lens. In various non-limiting, exemplary embodiments the optical scanning device may include some or all of the following features, components, steps, limitations, and/or characteristics, alone or in non-limiting variations appreciated by those skilled in the art:
-wherein the pixelated light modulator has a lateral dimension that determines a direct object side field of view (FOV) of the laser range finder;
-further comprising a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, wherein at least one of a shape, a position, an orientation, and a dimension of which establish an indirect FOV of the laser range finder;
-wherein the controllable pixelated light modulator is a digital micromirror device (DMD); -wherein the controllable pixelated light modulator is a liquid crystal display (LCD);
-wherein the controllable pixelated light modulator is a grating light valve (GLV). An aspect of the invention is an optical scanning method. In a non-limiting exemplary embodiment, the optical scanning method includes the steps of providing a controllable pixelated light modulator having a plurality of individual pixel elements and a lateral dimension that determines a direct object side scanning field, providing a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted in a sagittal plane, imaging light from one or more points in the object side scanning field onto the pixelated light modulator by reflection from the pair of reflective surfaces, the shape, position and dimensions of which establish an indirect scanning field, and selectively controlling any of a plurality of selected arrangements of the pixel elements so as to map one or more points in the direct scanning field and the indirect scanning field to a single point in an image side a detection field. In various non-limiting, exemplary embodiments the optical scanning method may include some or all of the following steps, features, components, limitations, and/or characteristics, alone or in non-limiting variations appreciated by those skilled in the art:
-further comprising illuminating the one or more points in the object side of the objective lens with light so as to cause light to be emitted from those points and received at the single point on the image side of the objective lens;
-further comprising modulating the illuminating light, demodulating the light received at the single point on the image side of the objective lens, and determining a transit delay of the modulation envelope from the source of light to a detector to determine the distance of the scanning device to one or more of the points in the object side of the objective lens.
Brief Description of the Fig Fig. 1 A is a schematic block circuit layout of a pixelated light modulator (e.g., DMD, LCD, GLV (grating light valve)-based imaging Lidar system; Fig. IB is a schematic block circuit procedure of operation of a pixelated light modulator-based imaging Lidar system, according to illustrative embodiments of the invention.
Fig. 2(a) is a schematic side-view line drawing of a Lidar transmitter portion, Fig. 2(b) is a schematic top view line drawing of a DMD-based Lidar receiver portion, and Fig. 2(c) is a schematic side view line drawing of a DMD-based Lidar receiver portion, according to illustrative embodiments of the invention.
Fig. 3(a) is a schematic top view of a DMD-based Lidar receiver portion having an increased field-of-view (FOV), Fig. 3(b) is a schematic side view seen from positive z-axis of mirror components of the receiver portion shown in Fig. 3(a), Fig. 3(c) is a schematic side- view of the receiver portion shown in Fig. 3(a), according to illustrative embodiments of the invention.
Fig. 4(a) is a schematic perspective view ray trace diagram illustrating the imaging of the tangential rays by the DMD-based Lidar receiver portion, Fig. 4(b) is a schematic side view of ray trace diagram illustrating the imaging of the tangential rays by the DMD-based Lidar receiver portion, according to illustrative embodiments of the invention.
Fig. 5(a) is a schematic top view of a DMD-based Lidar receiver portion showing representative field points in a horizontal plane, Fig. 5(b) is a schematic side view of a DMD- based Lidar receiver portion showing representative field points in a vertical plane, according to illustrative embodiments of the invention.
Fig. 6(a), Fig. 6(b), and Fig. 6(c), respectively, diagrammatically illustrate image locations on the DMD for different FOVs, according to illustrative embodiments of the invention. Fig. 7 diagrammatically illustrates overlapping image locations in the DMD plane, according to an illustrative embodiment of the invention.
Fig. 8(a), Fig. 8(b), and Fig. 8(c) illustrate alternative principles of recovering the one- to-one mapping between horizontal and vertical FOVs to the intermediate image location on the DMD, according to illustrative embodiments of the invention.
Fig. 9 is a schematic box diagram illustrating control and measurement by a Lidar system, according to an illustrative embodiment of the invention.
Detailed Description of Exemplary, Non-limiting Embodiments of the Invention Fig. 1 A is a schematic block circuit layout of a pixelated light modulator (e.g., DMD, LCD, GLV (grating light valve)-based imaging Lidar system. Fig. IB is a schematic block circuit procedure of operation of a pixelated light modulator-based imaging Lidar system. As an advantageous embodiment utilizes a digital micromirror device (DMD) as the enabling pixelated light modulator, the term DMD will be used hereinafter in describing all embodiments as a matter of convenience.
For each distance sampling, the microcontroller (e.g., Arduino) triggers a 905 nm laser pulse and also starts a timer in the Time-to-Digital Converter (TDC) Integrated Circuit (IC). The laser pulse is propagated through the transmission optics, reflected by the target field, spatially filtered by the DMD, and captured by an avalanche photodiode (APD). The APD emits a short (20 ns, 100 mV) electrical pulse which is then amplified by an electrical signal amplifier. A comparator IC recognizes the pulse and sends a digital signal (3 V) to the TDC to stop the timer. The TDC uses an 8.196 MHz clock to calibrate each measurement. The TDC sends the serial data of the differential time, in nanoseconds, between the start and stop digital signals to the microcontroller, which filters out the error reads, averages multiple time measurements, and calculates the distance to the target at that particular field position. The microcontroller then increments the DMD pattern to test a new field location before restarting the distance measurements.
The embodied invention enables high resolution, wide FOV, non-mechanical scanning of receiver optics by using microelectromechanical (MEMS)- based optical devices such as a DMD.
Schematic ray diagrams are shown in Figs. 2(a, b, c). Fig. 2a illustrates a LIDAR transmitter portion of the system. Pulsed and/or modulated laser- or LED-sourced light is emitted by a scanning laser device such as conventional rotating polygon mirror or, alternatively as shown, by an array of laser diodes (LDs) or light emitting diodes (LEDs) 10, which provide non-mechanical illumination of an object or target scene. The target field is flood illuminated or partially flood illuminated by the array of light sources. A scanning lens 12 causes the beam to be collimated or slightly diverging to cover the field of view of the receiving optics.
As illustrated in Figs. 2b (top view) and 2c (side view), a receiving portion comprises an imaging lens 14, a DMD 16, a beam splitter, such as a frustrated total internal reflection (FTIR) prism 18, detection optics 20, and photo detector 22. The entire field of view (FOV) from the target or object side is imaged by the imaging lens 14. The objects illuminated within the FOV are imaged onto the DMD device 16 by imaging lens 14. The DMD device selectively reflects the light from the illuminated object field towards detection optics 20. For example, a single DMD pixel may be partially actuated while the remaining pixels are all turned off. The deflected beam is routed toward the photo detector 22 by a FTIR prism 18 to minimize loss, or alternatively by a beam splitter. Alternatively, off-axis imaging in the vertical direction may be employed to avoid using a beam splitter or an FTIR prism. Finally, the detection optics 20 delivers light to the photo detector 22. Given the focal length, of the imaging optics, the angular resolution, ΔΘ, in units of radians is given by d/f, where d is the pitch of the DMD device. Typically the pixel pitch, d, is on the order of 5-20 micrometer, whereas the focal length, of the imaging lens is on the order of 1-100 mm. Assuming that the pitch d of the DMD pixel is 10 μπι, (0.01 mm), ΔΘ is 1E-2 to 1E-4 radians, which corresponds to 0.573 and 0.00573 degrees, respectively.
Therefore, a high resolution scan is possible in the embodied imaging geometry.
The full field of view of the passive LIDAR device is limited by the horizontal (x-z plane) extent, L, of DMD 14 and the focal length, of the imaging optics and is given by 2 tan_1(L/2 ) for a well-corrected imaging system. Similar to the conventional imaging optics, there is a trade-off between the angular resolution and full FOV. For example, longer focal length provides a higher angular resolution; however, the full FOV becomes smaller.
Referring to Figs. 3(a, b,c), this limitation is overcome in the embodied invention by inserting a pair of lateral reflectors, such as mirrors 24 and 26, whose reflecting surfaces are advantageously parallel and facing each other. The pair of reflectors 24, 26 are located along the optical axis 28 of the imaging optics. The respective surface normals of the pair of mirrors are tilted to the horizontal (x-z) scanning (sagittal) plane of the imaging optics between 1-10 degrees. Since the chief ray angle, φ, with respect to the optical axis has to be a finite value, the pair of mirrors remaps the horizontal scanning angle to the DMD plane in a folded and tilted manner. Fig. 3 c schematically depicts the effect of the functionality of the pair of mirrors. The implementation is effective especially for Lidar for automotive applications, since the full vertical FOV is relatively small (10-20 degrees) compared to the horizontal FOV (60-180) degrees.
Figs. 4(a,b) illustrate the receiver/detection optics portion of the system. As shown, a linear array 30 of retro-reflectors such as, e.g., roof mirrors or roof mirror prisms. An object field/target is imaged by lens 14 on to the DMD 28. The image formed on the DMD is an intermediate image. In the tangential plane 32 the intermediate image is re-imaged onto a photo detector 22 by a cylindrical lens 34 as shown by tangential rays 36 (rays 40 are sagittal rays). As shown in Figure 4a, the cylindrical lens images the tangential rays from the intermediate image on the DMD to the detector 22 by reflection from one of the roof mirrors.
In the sagittal plane 38, rays 40 are reflected toward and through the cylindrical lens 34 without refraction. As shown in Figure 4b, the nominal plane of the retroreflector array 30 is oriented with respect to the nominal plane of the DMD 28 and the detector 22 so that the diverging sagittal rays 40 from the DMD are reflected by the retroreflector towards and converge upon the detector 22. The surface normal of the retroreflector array is tilted in the tangential plane so that the final image is displaced with respect to the DMD to accommodate the detector 22. As a result, the intermediate image is re-imaged to detector 22 by two different means for the tangential and sagittal rays, respectively. In this embodiment, the size of detector 22 in the tangential direction is determined by magnification of the cylindrical lens 34. In the sagittal direction, the size of the detector 22 is identical to the lateral dimension of the DMD since the linear roof mirror array 30 has unit magnification. To match the field of view of the detector 22 to the size of the DMD, additional lens units 29 in front of the detector may be inserted when matching the size of the detector to DMD is desired.
As disclosed above, the pair of reflectors 24, 26 located along the optical axis 28 of the imaging optics provide an increased indirect FOV of the system. The structure and operation of the lateral mirrors 24 and 26 for expanding the lateral field of view is further explained with respect to Figs. 5-8.
Referring to Figs. 5a, 5b, respectively, representative field points in the horizontal (x- z plane) direction (H-2, H-l, H-0, H+l, and H+2) as well as in the vertical (y-z plane) direction (V-l, V-0, V+l) are depicted. In Figs. 6(a, b, c), image locations on the DMD are depicted as black circles for each FOV. In Fig. 6b, image locations for H-2, H-l, H-0, H+l, and H+2 with the V-0 vertical field are depicted as image points 1-2, 1-1, 1-0, 1+1, 1+2, respectively, and similarly for the Hzn points for V-l and V+l in Figs. 6(a) and 6(b), respectively. The light captured within the (direct) field of view H-l to H+l is not reflected by the parallel mirrors, and goes straight to the DMD. On the other hand, light from an object outside of the H+l and H-l field (i.e., extended FOV), which would otherwise miss the DMD, is reflected by the mirrors, and forms image points such as 1+2 for H+2 and 1-2 for H-2. While increasing the FOV, the trajectory of the image location on the DMD forms a zig-zag line pattern as depicted in Fig. 7. Thus, there is a one-to-one correspondence between the field of view and image location on the DMD device; a line-like object is imaged to a zigzag pattern. Figs. 6a, 6b, and 6c depict the trajectory of image locations for vertical fields of view, V-l, V-0, and V+l . The zigzag pattern remains the same as the vertical field of view, whereas mutual shifts along the y-direction among the patterns are induced by the vertical field of view. The zigzag pattern remains the same for V-l, V-0, and V+l, but shifts progressively along the y-direction, such that the individual patterns overlap each other.
The overlapped zigzag patterns effectively fill the DMD plane. However, one-to-one mapping between the object and DMD is not maintained specifically at the points where each of the zig-zag patterns overlap each other, as shown in Fig. 7. One must then distinguish from what vertical FOV (V0, V+l, V-l) the light comes from.
The problem can be solved by using slice illumination and/or applying an orthogonal light modulation code among each vertical field of view. Figs. 8(a,b,c) show the principle of recovering the one-to-one mapping between horizontal and vertical fields of view to the intermediate image location on the DMD device. The light transmitter consists of an array of light sources. Each light source is a collimated light source scanning a horizontal FOV or a light source collimated in the tangential (vertical) plane and converging or diverging in the sagittal (horizontal) plane. In either implementation, each light source covers only a limited portion of the vertical FOV. Upon scanning the vertical and horizontal fields of view, the transmitter selectively turns on the illuminating light by which the vertical FOV is selected by the transmitter. Upon receiving light, a portion of the DMD mirror is selectively turned on to select the horizontal FOV.
In another implementation shown in Fig. 8c, each of the light transmitters is modulated in an orthogonal manner.
Lidar may be implemented by a control and measurement system as shown in Fig. 9. In the case of a diode array scanner, for example, a controller activates the laser diode of the array to select the vertical FOV. The laser diodes are turned on by a timing pulse created by the controller. The wave shape of the resulting laser pulse advantageously is Gaussian for a time-of-flight based distance measurement. Alternatively, a modulated pulse shape may be used. At the same time, the controller drives the DMD to select the horizontal FOV by turning on the corresponding pixel(s). The reflected laser light from an object is detected by the detector. The detected signal is compared with the timing pulse. For time of flight measurement, the delay of the detected pulse with respect to the timing pulse is measured. Alternatively, a correlation operation as a function of delay time measured with respect to the timing pulse is carried out for the modulated pulse shape. The time delay provides distance information for the vertical FOV by selection of the illumination source, and selection of the pixel(s) of the DMD. The horizontal scanning operation is repeated for the full vertical and horizontal FOVs of the system.

Claims

We claim:
1. An optical scanning device, comprising:
an objective lens having an optical axis;
a controllable pixelated light modulator having a plurality of individual pixel elements and a lateral dimension, disposed along the optical axis on an image side of the objective lens, wherein a direct field of view of the optical scanning device is set by said lateral dimension;
a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, such that a wide angle point on an object side of the objective lens is mapped to a respective pixel of the pixelated light modulator;
a controller coupled to the pixelated light modulator in a manner to selectively control any of a plurality of selected arrangements of the pixel elements so as to map the point on the object side of the objective lens to a single point on an image side of the objective lens; and
a detector disposed so as to produce a signal representative of the intensity of light emitted from one or more points in front of the objective lens as the controller selectively controls the pixelated light modulator.
2. The scanning device of claim 1, wherein the pair of lateral reflective surfaces have respective substantially-flat reflective surfaces that are disposed substantially parallel to one another.
3. The scanning device of claim 1, wherein each one of the pair of lateral reflective surfaces are tilted from between zero to 10 degrees.
4. The scanning device of claim 1, wherein the controllable pixelated light modulator is a digital micromirror device (DMD).
5. The scanning device of claim 1, wherein the controllable pixelated light modulator is a liquid crystal display (LCD).
6. The scanning device of claim 1, wherein the controllable pixelated light modulator is a grating light valve (GLV).
7. The optical scanning device of claim 1, further comprising a one dimensional focusing element disposed so as to focus tangential rays reflected from the pixelated light modulator.
8. The optical scanning device of claim 7, wherein the one dimensional focusing element is a cylindrical lens.
9. The optical scanning device of claim 1, further comprising an array of roof mirrors disposed between the pixelated light modulator and the detector, wherein sagittal light rays from the pixelated light modulator are guided to the detector.
10. The optical scanning device of claim 1, further comprising an optical path selector disposed between the objective lens and the micro-mirror array to map individual micro- mirrors both to a corresponding point in front of the objective lens and to the single point in back of the objective lens.
11. The optical scanning device of claim 10, wherein the optical path selector is a beam splitter.
12. The optical scanning device of claim 10, wherein the optical path selector is a frustrated total internal reflection prism.
13. The optical scanning device of claim 1, further comprising a scanner illumination source modulator adapted to modulate the scanner illumination and a demodulator coupled to the detector to demodulate the light directed to the detector by the pixelated light modulator wherein a transit delay of a modulation envelope from the illumination source to the detector can be used to determine a distance of the scanning device from an illuminated object.
14. An optical scanning method, comprising:
providing a controllable pixelated light modulator having a plurality of individual pixel elements and a lateral dimension that determines a direct object side scanning field;
providing a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted in a sagittal plane;
imaging light from one or more points in the object side scanning field onto the pixelated light modulator by reflection from the pair of reflective surfaces , the shape,
position and dimensions of which establish an indirect scanning field; and selectively controlling any of a plurality of selected arrangements of the pixel elements so as to map one or more points in the direct scanning field and the indirect scanning field to a single point in an image side a detection field.
15. The optical scanning method of claim 14, further comprising illuminating the one or more points in the object side of the objective lens with light so as to cause light to be emitted from those points and received at the single point on the image side of the objective lens.
16. The optical scanning method of claim 15, further comprising modulating the illuminating light, demodulating the light received at the single point on the image side of the objective lens, and determining a transit delay of the modulation envelope from the source of light to a detector to determine the distance of the scanning device to one or more of the points in the object side of the objective lens.
17. A laser range finder, comprising:
an objective lens having an optical axis, an object side, and an image side;
a controllable pixelated light modulator disposed along the optical axis on the image side of the lens; and
a detector disposed optically downstream from the pixelated light modulator on the image side of the lens.
18. The laser range finder of claim 17, wherein the pixelated light modulator has a lateral dimension that determines a direct object side field of view (FOV) of the laser range finder.
19. The laser range finder of claim 18, further comprising a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, wherein at least one of a shape, a position, an orientation, and a dimension of which establish an indirect FOV of the laser range finder.
20. The scanning device of claim 17, wherein the controllable pixelated light modulator is a digital micromirror device (DMD).
21. The scanning device of claim 17, wherein the controllable pixelated light modulator is a liquid crystal display (LCD).
22. The scanning device of claim 17, wherein the controllable pixelated light modulator is a grating light valve (GLV).
PCT/US2016/047767 2015-08-31 2016-08-19 Range-finder apparatus, methods, and applications Ceased WO2017040066A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/756,290 US10281262B2 (en) 2015-08-31 2016-08-19 Range-finder apparatus, methods, and applications

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201562212525P 2015-08-31 2015-08-31
US62/212,525 2015-08-31

Publications (1)

Publication Number Publication Date
WO2017040066A1 true WO2017040066A1 (en) 2017-03-09

Family

ID=58187946

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2016/047767 Ceased WO2017040066A1 (en) 2015-08-31 2016-08-19 Range-finder apparatus, methods, and applications

Country Status (2)

Country Link
US (1) US10281262B2 (en)
WO (1) WO2017040066A1 (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3428687A1 (en) * 2017-07-14 2019-01-16 Veoneer Sweden AB A vision system and vision method for a vehicle
WO2019084130A1 (en) * 2017-10-25 2019-05-02 Bae Systems Information And Electronic Systems Integration Inc. Method and system of digital light processing and light detection and ranging for guided autonomous vehicles
WO2019096584A1 (en) * 2017-11-15 2019-05-23 Osram Gmbh Distance measurement unit
CN109814128A (en) * 2019-01-23 2019-05-28 北京理工大学 The high-resolution fast imaging system and method that time flight is combined with relevance imaging
WO2019201515A1 (en) * 2018-04-19 2019-10-24 Osram Gmbh Distance-measuring unit
WO2020022146A1 (en) * 2018-07-27 2020-01-30 京セラ株式会社 Electromagnetic wave detector and information acquisition system
WO2020022147A1 (en) * 2018-07-27 2020-01-30 京セラ株式会社 Electromagnetic wave detection device and information acquisition system
CN110940960A (en) * 2018-09-21 2020-03-31 宁波舜宇车载光学技术有限公司 Laser radar scanning system and laser radar scanning method
WO2020115856A1 (en) * 2018-12-06 2020-06-11 三菱電機株式会社 Laser radar device
EP3622333A4 (en) * 2017-05-10 2021-06-23 Gerard Dirk Smits SCAN MIRROR METHODS AND SYSTEMS
US11137497B2 (en) 2014-08-11 2021-10-05 Gerard Dirk Smits Three-dimensional triangulation and time-of-flight based tracking systems and methods
EP3792677A4 (en) * 2018-05-08 2022-06-08 Kyocera Corporation ELECTROMAGNETIC WAVE DETECTION DEVICE AND INFORMATION ACQUISITION SYSTEM
US11709236B2 (en) 2016-12-27 2023-07-25 Samsung Semiconductor, Inc. Systems and methods for machine perception
US11714170B2 (en) 2015-12-18 2023-08-01 Samsung Semiconuctor, Inc. Real time position sensing of objects
US11829059B2 (en) 2020-02-27 2023-11-28 Gerard Dirk Smits High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array
US12025807B2 (en) 2010-10-04 2024-07-02 Gerard Dirk Smits System and method for 3-D projection and enhancements for interactivity
US12542890B2 (en) 2010-10-04 2026-02-03 Voxelsensors Srl System and method for 3-D projection and enhancements for interactivity

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11237251B2 (en) * 2016-05-11 2022-02-01 Texas Instruments Incorporated Lidar scanning with expanded scan angle
US10365351B2 (en) * 2017-03-17 2019-07-30 Waymo Llc Variable beam spacing, timing, and power for vehicle sensors
JP7246151B2 (en) * 2018-09-26 2023-03-27 京セラ株式会社 Electromagnetic wave detector
US11709231B2 (en) * 2018-12-21 2023-07-25 Infineon Technologies Ag Real time gating and signal routing in laser and detector arrays for LIDAR application
CN110441754B (en) * 2019-07-22 2022-08-30 中国科学院上海光学精密机械研究所 Optical receiving device with controllable optical efficiency of subdivided field of view
NO346479B1 (en) * 2020-11-11 2022-08-29 Toerring Invest As Ranging Detection
US11892572B1 (en) 2020-12-30 2024-02-06 Waymo Llc Spatial light modulator retroreflector mitigation
US12429322B2 (en) 2022-03-15 2025-09-30 Carlisle Construction Materials, LLC Locating, measuring, and error-checking system
CN114895288B (en) * 2022-05-10 2022-11-15 哈尔滨方聚科技发展有限公司 Laser echo generation system for three-dimensional scene

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6388738B1 (en) * 1999-03-03 2002-05-14 Asahi Kogaku Kogyo Kabushiki Kaisha Rangefinder optical system
US6515734B1 (en) * 1999-12-06 2003-02-04 Olympus Optical Co., Ltd. Exposure apparatus
US20050123239A1 (en) * 2001-11-10 2005-06-09 Samsung Electronics Co., Ltd. Optical coupling device, method of producing the same, and optical apparatus using the same
US20090141336A1 (en) * 2007-11-30 2009-06-04 Lumination Llc Projection display devices employing frustrated total internal reflection
US8531650B2 (en) * 2008-07-08 2013-09-10 Chiaro Technologies LLC Multiple channel locating
US20140049783A1 (en) * 2011-03-17 2014-02-20 Universitat Politècnica De Catalunya System, method and computer program for receiving a light beam

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6388738B1 (en) * 1999-03-03 2002-05-14 Asahi Kogaku Kogyo Kabushiki Kaisha Rangefinder optical system
US6515734B1 (en) * 1999-12-06 2003-02-04 Olympus Optical Co., Ltd. Exposure apparatus
US20050123239A1 (en) * 2001-11-10 2005-06-09 Samsung Electronics Co., Ltd. Optical coupling device, method of producing the same, and optical apparatus using the same
US20090141336A1 (en) * 2007-11-30 2009-06-04 Lumination Llc Projection display devices employing frustrated total internal reflection
US8531650B2 (en) * 2008-07-08 2013-09-10 Chiaro Technologies LLC Multiple channel locating
US20140049783A1 (en) * 2011-03-17 2014-02-20 Universitat Politècnica De Catalunya System, method and computer program for receiving a light beam

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12542890B2 (en) 2010-10-04 2026-02-03 Voxelsensors Srl System and method for 3-D projection and enhancements for interactivity
US12025807B2 (en) 2010-10-04 2024-07-02 Gerard Dirk Smits System and method for 3-D projection and enhancements for interactivity
US11137497B2 (en) 2014-08-11 2021-10-05 Gerard Dirk Smits Three-dimensional triangulation and time-of-flight based tracking systems and methods
US11714170B2 (en) 2015-12-18 2023-08-01 Samsung Semiconuctor, Inc. Real time position sensing of objects
US11709236B2 (en) 2016-12-27 2023-07-25 Samsung Semiconductor, Inc. Systems and methods for machine perception
EP3622333A4 (en) * 2017-05-10 2021-06-23 Gerard Dirk Smits SCAN MIRROR METHODS AND SYSTEMS
US11067794B2 (en) 2017-05-10 2021-07-20 Gerard Dirk Smits Scan mirror systems and methods
EP3428687A1 (en) * 2017-07-14 2019-01-16 Veoneer Sweden AB A vision system and vision method for a vehicle
WO2019012085A1 (en) * 2017-07-14 2019-01-17 Veoneer Sweden Ab A vision system and vision method for a vehicle
WO2019084130A1 (en) * 2017-10-25 2019-05-02 Bae Systems Information And Electronic Systems Integration Inc. Method and system of digital light processing and light detection and ranging for guided autonomous vehicles
US12130386B2 (en) 2017-11-15 2024-10-29 Osram Beteiligungsverwaltung Gmbh Distance measurement unit
WO2019096584A1 (en) * 2017-11-15 2019-05-23 Osram Gmbh Distance measurement unit
WO2019201515A1 (en) * 2018-04-19 2019-10-24 Osram Gmbh Distance-measuring unit
US12248096B2 (en) 2018-04-19 2025-03-11 Osram Beteiligungsverwaltung Gmbh Distance-measuring unit with a detection field subdivided into a plurality of receiver solid angle segments
US12072234B2 (en) 2018-05-08 2024-08-27 Kyocera Corporation Electromagnetic wave detection apparatus and information acquisition system
EP3792677A4 (en) * 2018-05-08 2022-06-08 Kyocera Corporation ELECTROMAGNETIC WAVE DETECTION DEVICE AND INFORMATION ACQUISITION SYSTEM
WO2020022147A1 (en) * 2018-07-27 2020-01-30 京セラ株式会社 Electromagnetic wave detection device and information acquisition system
EP3832274A4 (en) * 2018-07-27 2022-05-04 Kyocera Corporation Electromagnetic wave detector and information acquisition system
JP7257751B2 (en) 2018-07-27 2023-04-14 京セラ株式会社 Electromagnetic wave detector
JP2020016605A (en) * 2018-07-27 2020-01-30 京セラ株式会社 Electromagnetic wave detection device and information acquisition system
WO2020022146A1 (en) * 2018-07-27 2020-01-30 京セラ株式会社 Electromagnetic wave detector and information acquisition system
US12248072B2 (en) 2018-07-27 2025-03-11 Kyocera Corporation Electromagnetic wave detection apparatus and information acquisition system
CN110940960A (en) * 2018-09-21 2020-03-31 宁波舜宇车载光学技术有限公司 Laser radar scanning system and laser radar scanning method
JPWO2020115856A1 (en) * 2018-12-06 2021-02-18 三菱電機株式会社 Laser radar device
WO2020115856A1 (en) * 2018-12-06 2020-06-11 三菱電機株式会社 Laser radar device
CN109814128B (en) * 2019-01-23 2020-08-11 北京理工大学 High-resolution rapid imaging system and method combining time flight and associated imaging
CN109814128A (en) * 2019-01-23 2019-05-28 北京理工大学 The high-resolution fast imaging system and method that time flight is combined with relevance imaging
US11829059B2 (en) 2020-02-27 2023-11-28 Gerard Dirk Smits High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array

Also Published As

Publication number Publication date
US10281262B2 (en) 2019-05-07
US20180252513A1 (en) 2018-09-06

Similar Documents

Publication Publication Date Title
US10281262B2 (en) Range-finder apparatus, methods, and applications
JP7332210B2 (en) 3D imaging system
CN107209265B (en) Optical detection and distance measurement device
KR102352206B1 (en) Multiple hypothesized LIDAR device range aliasing resilience
US10018724B2 (en) System and method for scanning a surface and computer program implementing the method
US11561287B2 (en) LIDAR sensors and methods for the same
KR101785253B1 (en) LIDAR Apparatus
US12117565B2 (en) Methods and systems for dithering active sensor pulse emissions
CN114222930A (en) System and method for photodiode-based detection
KR101785254B1 (en) Omnidirectional LIDAR Apparatus
CN103975250A (en) Spatially selective detection using a dynamic mask in an image plane
JP7230443B2 (en) Distance measuring device and moving object
CN111837055A (en) Optical device, distance sensor using optical device, and moving object
KR102209500B1 (en) Lidar apparatus
KR101867967B1 (en) Polyhedron optical structure for 360˚ laser scanning and 3d lidar system comprising the same
CN110658527A (en) LiDAR, Autonomous Mobile Robots and Smart Vehicles
CN114690154A (en) Optical transmitter module, sensor system and method for retroreflector mitigation
JP2020536245A (en) Full waveform multi-pulse optical distance meter
US20240241225A1 (en) Eye safe lidar system with variable resolution multi-beam scanning
CN114144698A (en) Anti-reflection label for laser radar window
KR102350621B1 (en) Lidar apparatus
KR20200055655A (en) Lidar sensors and methods for lidar sensors
KR102915225B1 (en) Light emitting module and lidar
US12372778B2 (en) Actuators and couplers for scanning mirrors
US20240241236A1 (en) Dynamic Alignment and Optical Stabilization of Optical Path in an Automotive-Grade LIDAR

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16842580

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16842580

Country of ref document: EP

Kind code of ref document: A1