WO2017040066A1 - Range-finder apparatus, methods, and applications - Google Patents
Range-finder apparatus, methods, and applications Download PDFInfo
- Publication number
- WO2017040066A1 WO2017040066A1 PCT/US2016/047767 US2016047767W WO2017040066A1 WO 2017040066 A1 WO2017040066 A1 WO 2017040066A1 US 2016047767 W US2016047767 W US 2016047767W WO 2017040066 A1 WO2017040066 A1 WO 2017040066A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- light modulator
- objective lens
- scanning device
- pixelated light
- detector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/14—Measuring arrangements characterised by the use of optical techniques for measuring distance or clearance between spaced objects or spaced apertures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/22—Measuring arrangements characterised by the use of optical techniques for measuring depth
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C3/00—Measuring distances in line of sight; Optical rangefinders
- G01C3/02—Details
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/42—Simultaneous measurement of distance and other co-ordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
- G01S17/931—Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
- G01S7/4815—Constructional features, e.g. arrangements of optical elements of transmitters alone using multiple transmitters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4817—Constructional features, e.g. arrangements of optical elements relating to scanning
Definitions
- Range-finder Apparatus Apparatus, Methods, and Applications
- aspects and embodiments of the invention are directed to range-finding apparatus, methods, and applications thereof. More particularly, aspects and embodiments are directed to lidar and optical scanning apparatus, methods, and applications and, most particularly to range-finder apparatus having a wide field of view, associated methods, and applications thereof.
- Mapping the distance to objects by measuring a time of flight has become one of the main sensing schemes for the purpose of improving the safety of automotive transportation and autonomously driven vehicles.
- Distances to objects such as cars, pedestrians, and obstacles may be measured, for example, over a 360 degree field of view with sub one (1) degree resolution and a 10 fps frame rate by launching a nano-second pulse from a laser toward an object.
- the reflected light from the object is detected by a detector, comprising for example, a silicon photo diode or an avalanche photo diode (APD).
- the distance between the light source and the object is measured by detecting the delay between the launching of the pulse by the laser and the arrival of the echo at the detector.
- Such a distance measurement system used along with object recognition can be used to reduce the probability of car accidents.
- autonomous driving requires some range finding mechanism such as laser range finding.
- Laser range finding is also of interest for consumer applications, such as robot cleaners and others. Mapping of objects in a room, for example, by a distance measurement increases the area throughout the room that can be cleaned by providing additional information to the existing routing algorithm.
- a new generation of Lidar systems with high resolution, high ranging accurate, and high frame rate is heading toward the direction of miniaturization, light weight, portability, and low cost and has been applied widely in the civilian and military fields such as laser ranging, topography, architectural drawing, environmental monitoring, vehicle driving navigation, unmanned ground vehicle navigation, etc.
- a resonant scanner can be considered one of the important components because of its huge advantages, including fast scanning speed, flexibility, low power consumption, etc.
- the mechanical tilt angle of a resonant scanner with a small aperture of 10 mm x 6 mm has a maximum optical full scan angle of only about 50°, which is simply not enough for a Lidar system for autonomous applications.
- a light detection and ranging (lidar) system is currently relatively expensive.
- a Lidar system currently offered by Verodyne has been found to cost about $80,000.
- the system employs conventional mechanical scanning; that is, both the laser sources and the detectors are mounted on a rotating mechanical mount. Pulsed light from the laser is collimated by a lens and directed toward an object, and an echo of the pulse coming off the object is captured by detector optics and focused on the detector, while the entire optical setup is rotating at a high speed.
- This mechanical scanning approach is believed to be the most effective mechanical scanning approach currently available. Since the light is collimated, the laser power density at the object is high, thus the reflected signal can be detected with a high signal-to-noise ratio (S R).
- S R signal-to-noise ratio
- non-mechanical scanning is ideal to avoid failure of the scanning mechanism carrying the transmitter and the receiver.
- a rotating polygon mirror may be used to scan a laser across a scene, or a flood illumination array of laser diodes (LDs) or light emitting diodes (LEDs) can provide non- mechanical scanning.
- LDs laser diodes
- LEDs light emitting diodes
- receiver optics there is no viable solution available to map distance and angular position of an object other than low resolution avalanche photo diode (APD) arrays whose resolution is very low compared to the desired specifications of 10 fps, 360 degree FOV, and sub one (1) degree resolution.
- APD avalanche photo diode
- the scanning device includes an objective lens having an optical axis, a controllable pixelated light modulator disposed along the optical axis on an image side of the objective lens and having a plurality of individual pixel elements and a lateral dimension, wherein a direct field of view of the optical scanning device is set by said lateral dimension, a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, wherein an extended field of view is set by said pair of reflective surfaces such that a point outside of the direct field of view on an object side of the objective lens is mapped to a respective pixel of the pixelated light modulator, a controller coupled to the pixelated light modulator in a manner to selectively control any of a plurality of selected arrangements of the pixel elements so as to map a point from either the direct field of view or the
- the optical scanning device may include some or all of the following features, components, steps, limitations, and/or characteristics, alone or in non- limiting variations appreciated by those skilled in the art:
- pair of lateral reflective surfaces have respective substantially-flat reflective surfaces that are disposed substantially parallel to one another;
- each one of the pair of lateral reflective surfaces are tilted from between zero to 10 degrees;
- controllable pixelated light modulator is a digital micromirror device (DMD); -wherein the controllable pixelated light modulator is a liquid crystal display (LCD);
- DMD digital micromirror device
- LCD liquid crystal display
- controllable pixelated light modulator is a grating light valve (GLV);
- -further comprising a one dimensional focusing element disposed so as to focus tangential rays reflected from the pixelated light modulator;
- the one dimensional focusing element is a cylindrical lens
- -further comprising an array of roof mirrors disposed between the pixelated light modulator and the detector, wherein sagittal light rays from the pixelated light modulator are guided to the detector;
- -further comprising an optical path selector disposed between the objective lens and the micro-mirror array to map individual micro-mirrors both to a corresponding point in front of the objective lens and to the single point in back of the objective lens;
- optical path selector is a beam splitter; -wherein the optical path selector is a frustrated total internal reflection prism;
- a scanner illumination source modulator adapted to modulate the scanner illumination and a demodulator coupled to the detector to demodulate the light directed to the detector by the pixelated light modulator wherein a transit delay of a modulation envelope from the illumination source to the detector can be used to determine a distance of the scanning device from an illuminated object.
- the laser range finder includes an objective lens having an optical axis, an object side, and an image side, a controllable pixelated light modulator disposed along the optical axis on the image side of the lens, and a detector disposed optically downstream from the pixelated light modulator on the image side of the lens.
- the optical scanning device may include some or all of the following features, components, steps, limitations, and/or characteristics, alone or in non-limiting variations appreciated by those skilled in the art:
- the pixelated light modulator has a lateral dimension that determines a direct object side field of view (FOV) of the laser range finder;
- -further comprising a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, wherein at least one of a shape, a position, an orientation, and a dimension of which establish an indirect FOV of the laser range finder;
- controllable pixelated light modulator is a digital micromirror device (DMD); -wherein the controllable pixelated light modulator is a liquid crystal display (LCD);
- DMD digital micromirror device
- LCD liquid crystal display
- the controllable pixelated light modulator is a grating light valve (GLV).
- An aspect of the invention is an optical scanning method.
- the optical scanning method includes the steps of providing a controllable pixelated light modulator having a plurality of individual pixel elements and a lateral dimension that determines a direct object side scanning field, providing a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted in a sagittal plane, imaging light from one or more points in the object side scanning field onto the pixelated light modulator by reflection from the pair of reflective surfaces, the shape, position and dimensions of which establish an indirect scanning field, and selectively controlling any of a plurality of selected arrangements of the pixel elements so as to map one or more points in the direct scanning field and the indirect scanning field to a single point in an image side a detection field.
- the optical scanning method may include some
- -further comprising illuminating the one or more points in the object side of the objective lens with light so as to cause light to be emitted from those points and received at the single point on the image side of the objective lens;
- -further comprising modulating the illuminating light, demodulating the light received at the single point on the image side of the objective lens, and determining a transit delay of the modulation envelope from the source of light to a detector to determine the distance of the scanning device to one or more of the points in the object side of the objective lens.
- Fig. 1 A is a schematic block circuit layout of a pixelated light modulator (e.g., DMD, LCD, GLV (grating light valve)-based imaging Lidar system
- Fig. IB is a schematic block circuit procedure of operation of a pixelated light modulator-based imaging Lidar system, according to illustrative embodiments of the invention.
- a pixelated light modulator e.g., DMD, LCD, GLV (grating light valve)-based imaging Lidar system
- Fig. IB is a schematic block circuit procedure of operation of a pixelated light modulator-based imaging Lidar system, according to illustrative embodiments of the invention.
- Fig. 2(a) is a schematic side-view line drawing of a Lidar transmitter portion
- Fig. 2(b) is a schematic top view line drawing of a DMD-based Lidar receiver portion
- Fig. 2(c) is a schematic side view line drawing of a DMD-based Lidar receiver portion, according to illustrative embodiments of the invention.
- Fig. 3(a) is a schematic top view of a DMD-based Lidar receiver portion having an increased field-of-view (FOV)
- Fig. 3(b) is a schematic side view seen from positive z-axis of mirror components of the receiver portion shown in Fig. 3(a)
- Fig. 3(c) is a schematic side- view of the receiver portion shown in Fig. 3(a), according to illustrative embodiments of the invention.
- Fig. 4(a) is a schematic perspective view ray trace diagram illustrating the imaging of the tangential rays by the DMD-based Lidar receiver portion
- Fig. 4(b) is a schematic side view of ray trace diagram illustrating the imaging of the tangential rays by the DMD-based Lidar receiver portion, according to illustrative embodiments of the invention.
- Fig. 5(a) is a schematic top view of a DMD-based Lidar receiver portion showing representative field points in a horizontal plane
- Fig. 5(b) is a schematic side view of a DMD- based Lidar receiver portion showing representative field points in a vertical plane, according to illustrative embodiments of the invention.
- Fig. 6(a), Fig. 6(b), and Fig. 6(c), respectively, diagrammatically illustrate image locations on the DMD for different FOVs, according to illustrative embodiments of the invention.
- Fig. 7 diagrammatically illustrates overlapping image locations in the DMD plane, according to an illustrative embodiment of the invention.
- Fig. 8(a), Fig. 8(b), and Fig. 8(c) illustrate alternative principles of recovering the one- to-one mapping between horizontal and vertical FOVs to the intermediate image location on the DMD, according to illustrative embodiments of the invention.
- Fig. 9 is a schematic box diagram illustrating control and measurement by a Lidar system, according to an illustrative embodiment of the invention.
- Fig. 1 A is a schematic block circuit layout of a pixelated light modulator (e.g., DMD, LCD, GLV (grating light valve)-based imaging Lidar system.
- Fig. IB is a schematic block circuit procedure of operation of a pixelated light modulator-based imaging Lidar system.
- DMD digital micromirror device
- the term DMD will be used hereinafter in describing all embodiments as a matter of convenience.
- the microcontroller e.g., iOS
- the microcontroller triggers a 905 nm laser pulse and also starts a timer in the Time-to-Digital Converter (TDC) Integrated Circuit (IC).
- the laser pulse is propagated through the transmission optics, reflected by the target field, spatially filtered by the DMD, and captured by an avalanche photodiode (APD).
- the APD emits a short (20 ns, 100 mV) electrical pulse which is then amplified by an electrical signal amplifier.
- a comparator IC recognizes the pulse and sends a digital signal (3 V) to the TDC to stop the timer.
- the TDC uses an 8.196 MHz clock to calibrate each measurement.
- the TDC sends the serial data of the differential time, in nanoseconds, between the start and stop digital signals to the microcontroller, which filters out the error reads, averages multiple time measurements, and calculates the distance to the target at that particular field position.
- the microcontroller then increments the DMD pattern to test a new field location before restarting the distance measurements.
- the embodied invention enables high resolution, wide FOV, non-mechanical scanning of receiver optics by using microelectromechanical (MEMS)- based optical devices such as a DMD.
- MEMS microelectromechanical
- Fig. 2a illustrates a LIDAR transmitter portion of the system.
- Pulsed and/or modulated laser- or LED-sourced light is emitted by a scanning laser device such as conventional rotating polygon mirror or, alternatively as shown, by an array of laser diodes (LDs) or light emitting diodes (LEDs) 10, which provide non-mechanical illumination of an object or target scene.
- the target field is flood illuminated or partially flood illuminated by the array of light sources.
- a scanning lens 12 causes the beam to be collimated or slightly diverging to cover the field of view of the receiving optics.
- a receiving portion comprises an imaging lens 14, a DMD 16, a beam splitter, such as a frustrated total internal reflection (FTIR) prism 18, detection optics 20, and photo detector 22.
- the entire field of view (FOV) from the target or object side is imaged by the imaging lens 14.
- the objects illuminated within the FOV are imaged onto the DMD device 16 by imaging lens 14.
- the DMD device selectively reflects the light from the illuminated object field towards detection optics 20. For example, a single DMD pixel may be partially actuated while the remaining pixels are all turned off.
- the deflected beam is routed toward the photo detector 22 by a FTIR prism 18 to minimize loss, or alternatively by a beam splitter.
- the detection optics 20 delivers light to the photo detector 22.
- the angular resolution, ⁇ , in units of radians is given by d/f, where d is the pitch of the DMD device.
- d is the pitch of the DMD device.
- the pixel pitch, d is on the order of 5-20 micrometer, whereas the focal length, of the imaging lens is on the order of 1-100 mm.
- ⁇ is 1E-2 to 1E-4 radians, which corresponds to 0.573 and 0.00573 degrees, respectively.
- the full field of view of the passive LIDAR device is limited by the horizontal (x-z plane) extent, L, of DMD 14 and the focal length, of the imaging optics and is given by 2 tan _1 (L/2 ) for a well-corrected imaging system. Similar to the conventional imaging optics, there is a trade-off between the angular resolution and full FOV. For example, longer focal length provides a higher angular resolution; however, the full FOV becomes smaller.
- a pair of lateral reflectors such as mirrors 24 and 26, whose reflecting surfaces are advantageously parallel and facing each other.
- the pair of reflectors 24, 26 are located along the optical axis 28 of the imaging optics.
- the respective surface normals of the pair of mirrors are tilted to the horizontal (x-z) scanning (sagittal) plane of the imaging optics between 1-10 degrees. Since the chief ray angle, ⁇ , with respect to the optical axis has to be a finite value, the pair of mirrors remaps the horizontal scanning angle to the DMD plane in a folded and tilted manner.
- Fig. 3 c schematically depicts the effect of the functionality of the pair of mirrors. The implementation is effective especially for Lidar for automotive applications, since the full vertical FOV is relatively small (10-20 degrees) compared to the horizontal FOV (60-180) degrees.
- Figs. 4(a,b) illustrate the receiver/detection optics portion of the system.
- a linear array 30 of retro-reflectors such as, e.g., roof mirrors or roof mirror prisms.
- An object field/target is imaged by lens 14 on to the DMD 28.
- the image formed on the DMD is an intermediate image.
- the intermediate image is re-imaged onto a photo detector 22 by a cylindrical lens 34 as shown by tangential rays 36 (rays 40 are sagittal rays).
- the cylindrical lens images the tangential rays from the intermediate image on the DMD to the detector 22 by reflection from one of the roof mirrors.
- the nominal plane of the retroreflector array 30 is oriented with respect to the nominal plane of the DMD 28 and the detector 22 so that the diverging sagittal rays 40 from the DMD are reflected by the retroreflector towards and converge upon the detector 22.
- the surface normal of the retroreflector array is tilted in the tangential plane so that the final image is displaced with respect to the DMD to accommodate the detector 22.
- the intermediate image is re-imaged to detector 22 by two different means for the tangential and sagittal rays, respectively.
- the size of detector 22 in the tangential direction is determined by magnification of the cylindrical lens 34.
- the size of the detector 22 is identical to the lateral dimension of the DMD since the linear roof mirror array 30 has unit magnification.
- additional lens units 29 in front of the detector may be inserted when matching the size of the detector to DMD is desired.
- the pair of reflectors 24, 26 located along the optical axis 28 of the imaging optics provide an increased indirect FOV of the system.
- the structure and operation of the lateral mirrors 24 and 26 for expanding the lateral field of view is further explained with respect to Figs. 5-8.
- FIGs. 5a, 5b respectively, representative field points in the horizontal (x- z plane) direction (H-2, H-l, H-0, H+l, and H+2) as well as in the vertical (y-z plane) direction (V-l, V-0, V+l) are depicted.
- Figs. 6(a, b, c) image locations on the DMD are depicted as black circles for each FOV.
- image locations for H-2, H-l, H-0, H+l, and H+2 with the V-0 vertical field are depicted as image points 1-2, 1-1, 1-0, 1+1, 1+2, respectively, and similarly for the H z n points for V-l and V+l in Figs. 6(a) and 6(b), respectively.
- the light captured within the (direct) field of view H-l to H+l is not reflected by the parallel mirrors, and goes straight to the DMD.
- light from an object outside of the H+l and H-l field i.e., extended FOV
- Fig. 7 While increasing the FOV, the trajectory of the image location on the DMD forms a zig-zag line pattern as depicted in Fig. 7.
- Figs. 6a, 6b, and 6c depict the trajectory of image locations for vertical fields of view, V-l, V-0, and V+l .
- the zigzag pattern remains the same as the vertical field of view, whereas mutual shifts along the y-direction among the patterns are induced by the vertical field of view.
- the zigzag pattern remains the same for V-l, V-0, and V+l, but shifts progressively along the y-direction, such that the individual patterns overlap each other.
- the overlapped zigzag patterns effectively fill the DMD plane.
- one-to-one mapping between the object and DMD is not maintained specifically at the points where each of the zig-zag patterns overlap each other, as shown in Fig. 7.
- the problem can be solved by using slice illumination and/or applying an orthogonal light modulation code among each vertical field of view.
- Figs. 8(a,b,c) show the principle of recovering the one-to-one mapping between horizontal and vertical fields of view to the intermediate image location on the DMD device.
- the light transmitter consists of an array of light sources. Each light source is a collimated light source scanning a horizontal FOV or a light source collimated in the tangential (vertical) plane and converging or diverging in the sagittal (horizontal) plane. In either implementation, each light source covers only a limited portion of the vertical FOV.
- the transmitter Upon scanning the vertical and horizontal fields of view, the transmitter selectively turns on the illuminating light by which the vertical FOV is selected by the transmitter.
- a portion of the DMD mirror is selectively turned on to select the horizontal FOV.
- each of the light transmitters is modulated in an orthogonal manner.
- Lidar may be implemented by a control and measurement system as shown in Fig. 9.
- a controller activates the laser diode of the array to select the vertical FOV.
- the laser diodes are turned on by a timing pulse created by the controller.
- the wave shape of the resulting laser pulse advantageously is Gaussian for a time-of-flight based distance measurement.
- a modulated pulse shape may be used.
- the controller drives the DMD to select the horizontal FOV by turning on the corresponding pixel(s).
- the reflected laser light from an object is detected by the detector.
- the detected signal is compared with the timing pulse. For time of flight measurement, the delay of the detected pulse with respect to the timing pulse is measured.
- a correlation operation as a function of delay time measured with respect to the timing pulse is carried out for the modulated pulse shape.
- the time delay provides distance information for the vertical FOV by selection of the illumination source, and selection of the pixel(s) of the DMD.
- the horizontal scanning operation is repeated for the full vertical and horizontal FOVs of the system.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Electromagnetism (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
An imaging laser range finder including an objective lens having an optical axis, an object side, and an image side, a controllable pixelated light modulator disposed along the optical axis on the image side of the lens, and a detector disposed optically downstream from the pixelated light modulator on the image side of the lens. The controllable pixelated light modulator is advantageously a MEMS-based system such as a digital mirror device (DMD). An increased field of view may be obtained by incorporating a pair of opposing surface reflectors between an imaging lens and the controllable pixelated light modulator. Associated methods are disclosed.
Description
Range-finder Apparatus, Methods, and Applications
Related Application Data
The instant application claims priority to US provisional application 62/212,525 filed on 08/31/2015, the subject matter of which is incorporated by reference herein in its entirety.
Background
Aspects and embodiments of the invention are directed to range-finding apparatus, methods, and applications thereof. More particularly, aspects and embodiments are directed to lidar and optical scanning apparatus, methods, and applications and, most particularly to range-finder apparatus having a wide field of view, associated methods, and applications thereof.
Mapping the distance to objects by measuring a time of flight has become one of the main sensing schemes for the purpose of improving the safety of automotive transportation and autonomously driven vehicles. Distances to objects, such as cars, pedestrians, and obstacles may be measured, for example, over a 360 degree field of view with sub one (1) degree resolution and a 10 fps frame rate by launching a nano-second pulse from a laser toward an object. The reflected light from the object is detected by a detector, comprising for example, a silicon photo diode or an avalanche photo diode (APD). The distance between the light source and the object is measured by detecting the delay between the launching of the pulse by the laser and the arrival of the echo at the detector. Such a distance measurement system used along with object recognition can be used to reduce the probability of car accidents.
Also, autonomous driving requires some range finding mechanism such as laser range finding. Laser range finding is also of interest for consumer applications, such as robot
cleaners and others. Mapping of objects in a room, for example, by a distance measurement increases the area throughout the room that can be cleaned by providing additional information to the existing routing algorithm.
A new generation of Lidar systems with high resolution, high ranging accurate, and high frame rate is heading toward the direction of miniaturization, light weight, portability, and low cost and has been applied widely in the civilian and military fields such as laser ranging, topography, architectural drawing, environmental monitoring, vehicle driving navigation, unmanned ground vehicle navigation, etc. In Lidar systems, a resonant scanner can be considered one of the important components because of its huge advantages, including fast scanning speed, flexibility, low power consumption, etc. However, the mechanical tilt angle of a resonant scanner with a small aperture of 10 mm x 6 mm has a maximum optical full scan angle of only about 50°, which is simply not enough for a Lidar system for autonomous applications.
For automotive applications, a light detection and ranging (lidar) system is currently relatively expensive. For example a Lidar system currently offered by Verodyne has been found to cost about $80,000. The system employs conventional mechanical scanning; that is, both the laser sources and the detectors are mounted on a rotating mechanical mount. Pulsed light from the laser is collimated by a lens and directed toward an object, and an echo of the pulse coming off the object is captured by detector optics and focused on the detector, while the entire optical setup is rotating at a high speed. This mechanical scanning approach is believed to be the most effective mechanical scanning approach currently available. Since the light is collimated, the laser power density at the object is high, thus the reflected signal can be detected with a high signal-to-noise ratio (S R).
In low cost car and various consumer applications, non-mechanical scanning is ideal to avoid failure of the scanning mechanism carrying the transmitter and the receiver. For this
case, a rotating polygon mirror may be used to scan a laser across a scene, or a flood illumination array of laser diodes (LDs) or light emitting diodes (LEDs) can provide non- mechanical scanning. However for receiver optics, there is no viable solution available to map distance and angular position of an object other than low resolution avalanche photo diode (APD) arrays whose resolution is very low compared to the desired specifications of 10 fps, 360 degree FOV, and sub one (1) degree resolution.
Advantages and benefits over the current state of the art as well as solutions to problems associated with current state of the art apparatus and methods, appreciated by those skilled in the art, would be realized by improved range-finding and scanning apparatus and methods as enabled by the embodiments disclosed and claimed herein, particularly by the elimination of bulky mechanical scanning apparatus, increased field of view, and improved resolution of measurement data.
Summary
An aspect of the invention is an optical scanning device. In a non-limiting exemplary embodiment, the scanning device includes an objective lens having an optical axis, a controllable pixelated light modulator disposed along the optical axis on an image side of the objective lens and having a plurality of individual pixel elements and a lateral dimension, wherein a direct field of view of the optical scanning device is set by said lateral dimension, a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, wherein an extended field of view is set by said pair of reflective surfaces such that a point outside of the direct field of view on an object side of the objective lens is mapped to a respective pixel of the pixelated light modulator, a controller coupled to the pixelated light modulator in a manner to selectively control any of a plurality of selected
arrangements of the pixel elements so as to map a point from either the direct field of view or the extended field of view on the object side of the objective lens to a single point on an image side of the objective lens, and a detector disposed so as to produce a signal
representative of the intensity of light emitted from one or more points in front of the objective lens as the controller selectively controls the pixelated light modulator. In various non-limiting, exemplary embodiments the optical scanning device may include some or all of the following features, components, steps, limitations, and/or characteristics, alone or in non- limiting variations appreciated by those skilled in the art:
-wherein the pair of lateral reflective surfaces have respective substantially-flat reflective surfaces that are disposed substantially parallel to one another;
-wherein each one of the pair of lateral reflective surfaces are tilted from between zero to 10 degrees;
-wherein the controllable pixelated light modulator is a digital micromirror device (DMD); -wherein the controllable pixelated light modulator is a liquid crystal display (LCD);
-wherein the controllable pixelated light modulator is a grating light valve (GLV);
-further comprising a one dimensional focusing element disposed so as to focus tangential rays reflected from the pixelated light modulator;
-wherein the one dimensional focusing element is a cylindrical lens;
-further comprising an array of roof mirrors disposed between the pixelated light modulator and the detector, wherein sagittal light rays from the pixelated light modulator are guided to the detector;
-further comprising an optical path selector disposed between the objective lens and the micro-mirror array to map individual micro-mirrors both to a corresponding point in front of the objective lens and to the single point in back of the objective lens;
-wherein the optical path selector is a beam splitter;
-wherein the optical path selector is a frustrated total internal reflection prism;
-further comprising a scanner illumination source modulator adapted to modulate the scanner illumination and a demodulator coupled to the detector to demodulate the light directed to the detector by the pixelated light modulator wherein a transit delay of a modulation envelope from the illumination source to the detector can be used to determine a distance of the scanning device from an illuminated object.
An aspect of the invention is a laser range finder. In a non-limiting exemplary embodiment, the laser range finder includes an objective lens having an optical axis, an object side, and an image side, a controllable pixelated light modulator disposed along the optical axis on the image side of the lens, and a detector disposed optically downstream from the pixelated light modulator on the image side of the lens. In various non-limiting, exemplary embodiments the optical scanning device may include some or all of the following features, components, steps, limitations, and/or characteristics, alone or in non-limiting variations appreciated by those skilled in the art:
-wherein the pixelated light modulator has a lateral dimension that determines a direct object side field of view (FOV) of the laser range finder;
-further comprising a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, wherein at least one of a shape, a position, an orientation, and a dimension of which establish an indirect FOV of the laser range finder;
-wherein the controllable pixelated light modulator is a digital micromirror device (DMD); -wherein the controllable pixelated light modulator is a liquid crystal display (LCD);
-wherein the controllable pixelated light modulator is a grating light valve (GLV).
An aspect of the invention is an optical scanning method. In a non-limiting exemplary embodiment, the optical scanning method includes the steps of providing a controllable pixelated light modulator having a plurality of individual pixel elements and a lateral dimension that determines a direct object side scanning field, providing a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted in a sagittal plane, imaging light from one or more points in the object side scanning field onto the pixelated light modulator by reflection from the pair of reflective surfaces, the shape, position and dimensions of which establish an indirect scanning field, and selectively controlling any of a plurality of selected arrangements of the pixel elements so as to map one or more points in the direct scanning field and the indirect scanning field to a single point in an image side a detection field. In various non-limiting, exemplary embodiments the optical scanning method may include some or all of the following steps, features, components, limitations, and/or characteristics, alone or in non-limiting variations appreciated by those skilled in the art:
-further comprising illuminating the one or more points in the object side of the objective lens with light so as to cause light to be emitted from those points and received at the single point on the image side of the objective lens;
-further comprising modulating the illuminating light, demodulating the light received at the single point on the image side of the objective lens, and determining a transit delay of the modulation envelope from the source of light to a detector to determine the distance of the scanning device to one or more of the points in the object side of the objective lens.
Brief Description of the Fig
Fig. 1 A is a schematic block circuit layout of a pixelated light modulator (e.g., DMD, LCD, GLV (grating light valve)-based imaging Lidar system; Fig. IB is a schematic block circuit procedure of operation of a pixelated light modulator-based imaging Lidar system, according to illustrative embodiments of the invention.
Fig. 2(a) is a schematic side-view line drawing of a Lidar transmitter portion, Fig. 2(b) is a schematic top view line drawing of a DMD-based Lidar receiver portion, and Fig. 2(c) is a schematic side view line drawing of a DMD-based Lidar receiver portion, according to illustrative embodiments of the invention.
Fig. 3(a) is a schematic top view of a DMD-based Lidar receiver portion having an increased field-of-view (FOV), Fig. 3(b) is a schematic side view seen from positive z-axis of mirror components of the receiver portion shown in Fig. 3(a), Fig. 3(c) is a schematic side- view of the receiver portion shown in Fig. 3(a), according to illustrative embodiments of the invention.
Fig. 4(a) is a schematic perspective view ray trace diagram illustrating the imaging of the tangential rays by the DMD-based Lidar receiver portion, Fig. 4(b) is a schematic side view of ray trace diagram illustrating the imaging of the tangential rays by the DMD-based Lidar receiver portion, according to illustrative embodiments of the invention.
Fig. 5(a) is a schematic top view of a DMD-based Lidar receiver portion showing representative field points in a horizontal plane, Fig. 5(b) is a schematic side view of a DMD- based Lidar receiver portion showing representative field points in a vertical plane, according to illustrative embodiments of the invention.
Fig. 6(a), Fig. 6(b), and Fig. 6(c), respectively, diagrammatically illustrate image locations on the DMD for different FOVs, according to illustrative embodiments of the invention.
Fig. 7 diagrammatically illustrates overlapping image locations in the DMD plane, according to an illustrative embodiment of the invention.
Fig. 8(a), Fig. 8(b), and Fig. 8(c) illustrate alternative principles of recovering the one- to-one mapping between horizontal and vertical FOVs to the intermediate image location on the DMD, according to illustrative embodiments of the invention.
Fig. 9 is a schematic box diagram illustrating control and measurement by a Lidar system, according to an illustrative embodiment of the invention.
Detailed Description of Exemplary, Non-limiting Embodiments of the Invention Fig. 1 A is a schematic block circuit layout of a pixelated light modulator (e.g., DMD, LCD, GLV (grating light valve)-based imaging Lidar system. Fig. IB is a schematic block circuit procedure of operation of a pixelated light modulator-based imaging Lidar system. As an advantageous embodiment utilizes a digital micromirror device (DMD) as the enabling pixelated light modulator, the term DMD will be used hereinafter in describing all embodiments as a matter of convenience.
For each distance sampling, the microcontroller (e.g., Arduino) triggers a 905 nm laser pulse and also starts a timer in the Time-to-Digital Converter (TDC) Integrated Circuit (IC). The laser pulse is propagated through the transmission optics, reflected by the target field, spatially filtered by the DMD, and captured by an avalanche photodiode (APD). The APD emits a short (20 ns, 100 mV) electrical pulse which is then amplified by an electrical signal amplifier. A comparator IC recognizes the pulse and sends a digital signal (3 V) to the TDC to stop the timer. The TDC uses an 8.196 MHz clock to calibrate each measurement. The TDC sends the serial data of the differential time, in nanoseconds, between the start and stop digital signals to the microcontroller, which filters out the error reads, averages multiple time measurements, and calculates the distance to the target at that particular field position.
The microcontroller then increments the DMD pattern to test a new field location before restarting the distance measurements.
The embodied invention enables high resolution, wide FOV, non-mechanical scanning of receiver optics by using microelectromechanical (MEMS)- based optical devices such as a DMD.
Schematic ray diagrams are shown in Figs. 2(a, b, c). Fig. 2a illustrates a LIDAR transmitter portion of the system. Pulsed and/or modulated laser- or LED-sourced light is emitted by a scanning laser device such as conventional rotating polygon mirror or, alternatively as shown, by an array of laser diodes (LDs) or light emitting diodes (LEDs) 10, which provide non-mechanical illumination of an object or target scene. The target field is flood illuminated or partially flood illuminated by the array of light sources. A scanning lens 12 causes the beam to be collimated or slightly diverging to cover the field of view of the receiving optics.
As illustrated in Figs. 2b (top view) and 2c (side view), a receiving portion comprises an imaging lens 14, a DMD 16, a beam splitter, such as a frustrated total internal reflection (FTIR) prism 18, detection optics 20, and photo detector 22. The entire field of view (FOV) from the target or object side is imaged by the imaging lens 14. The objects illuminated within the FOV are imaged onto the DMD device 16 by imaging lens 14. The DMD device selectively reflects the light from the illuminated object field towards detection optics 20. For example, a single DMD pixel may be partially actuated while the remaining pixels are all turned off. The deflected beam is routed toward the photo detector 22 by a FTIR prism 18 to minimize loss, or alternatively by a beam splitter. Alternatively, off-axis imaging in the vertical direction may be employed to avoid using a beam splitter or an FTIR prism. Finally, the detection optics 20 delivers light to the photo detector 22.
Given the focal length, of the imaging optics, the angular resolution, ΔΘ, in units of radians is given by d/f, where d is the pitch of the DMD device. Typically the pixel pitch, d, is on the order of 5-20 micrometer, whereas the focal length, of the imaging lens is on the order of 1-100 mm. Assuming that the pitch d of the DMD pixel is 10 μπι, (0.01 mm), ΔΘ is 1E-2 to 1E-4 radians, which corresponds to 0.573 and 0.00573 degrees, respectively.
Therefore, a high resolution scan is possible in the embodied imaging geometry.
The full field of view of the passive LIDAR device is limited by the horizontal (x-z plane) extent, L, of DMD 14 and the focal length, of the imaging optics and is given by 2 tan_1(L/2 ) for a well-corrected imaging system. Similar to the conventional imaging optics, there is a trade-off between the angular resolution and full FOV. For example, longer focal length provides a higher angular resolution; however, the full FOV becomes smaller.
Referring to Figs. 3(a, b,c), this limitation is overcome in the embodied invention by inserting a pair of lateral reflectors, such as mirrors 24 and 26, whose reflecting surfaces are advantageously parallel and facing each other. The pair of reflectors 24, 26 are located along the optical axis 28 of the imaging optics. The respective surface normals of the pair of mirrors are tilted to the horizontal (x-z) scanning (sagittal) plane of the imaging optics between 1-10 degrees. Since the chief ray angle, φ, with respect to the optical axis has to be a finite value, the pair of mirrors remaps the horizontal scanning angle to the DMD plane in a folded and tilted manner. Fig. 3 c schematically depicts the effect of the functionality of the pair of mirrors. The implementation is effective especially for Lidar for automotive applications, since the full vertical FOV is relatively small (10-20 degrees) compared to the horizontal FOV (60-180) degrees.
Figs. 4(a,b) illustrate the receiver/detection optics portion of the system. As shown, a linear array 30 of retro-reflectors such as, e.g., roof mirrors or roof mirror prisms. An object field/target is imaged by lens 14 on to the DMD 28. The image formed on the DMD is an
intermediate image. In the tangential plane 32 the intermediate image is re-imaged onto a photo detector 22 by a cylindrical lens 34 as shown by tangential rays 36 (rays 40 are sagittal rays). As shown in Figure 4a, the cylindrical lens images the tangential rays from the intermediate image on the DMD to the detector 22 by reflection from one of the roof mirrors.
In the sagittal plane 38, rays 40 are reflected toward and through the cylindrical lens 34 without refraction. As shown in Figure 4b, the nominal plane of the retroreflector array 30 is oriented with respect to the nominal plane of the DMD 28 and the detector 22 so that the diverging sagittal rays 40 from the DMD are reflected by the retroreflector towards and converge upon the detector 22. The surface normal of the retroreflector array is tilted in the tangential plane so that the final image is displaced with respect to the DMD to accommodate the detector 22. As a result, the intermediate image is re-imaged to detector 22 by two different means for the tangential and sagittal rays, respectively. In this embodiment, the size of detector 22 in the tangential direction is determined by magnification of the cylindrical lens 34. In the sagittal direction, the size of the detector 22 is identical to the lateral dimension of the DMD since the linear roof mirror array 30 has unit magnification. To match the field of view of the detector 22 to the size of the DMD, additional lens units 29 in front of the detector may be inserted when matching the size of the detector to DMD is desired.
As disclosed above, the pair of reflectors 24, 26 located along the optical axis 28 of the imaging optics provide an increased indirect FOV of the system. The structure and operation of the lateral mirrors 24 and 26 for expanding the lateral field of view is further explained with respect to Figs. 5-8.
Referring to Figs. 5a, 5b, respectively, representative field points in the horizontal (x- z plane) direction (H-2, H-l, H-0, H+l, and H+2) as well as in the vertical (y-z plane) direction (V-l, V-0, V+l) are depicted. In Figs. 6(a, b, c), image locations on the DMD are
depicted as black circles for each FOV. In Fig. 6b, image locations for H-2, H-l, H-0, H+l, and H+2 with the V-0 vertical field are depicted as image points 1-2, 1-1, 1-0, 1+1, 1+2, respectively, and similarly for the Hzn points for V-l and V+l in Figs. 6(a) and 6(b), respectively. The light captured within the (direct) field of view H-l to H+l is not reflected by the parallel mirrors, and goes straight to the DMD. On the other hand, light from an object outside of the H+l and H-l field (i.e., extended FOV), which would otherwise miss the DMD, is reflected by the mirrors, and forms image points such as 1+2 for H+2 and 1-2 for H-2. While increasing the FOV, the trajectory of the image location on the DMD forms a zig-zag line pattern as depicted in Fig. 7. Thus, there is a one-to-one correspondence between the field of view and image location on the DMD device; a line-like object is imaged to a zigzag pattern. Figs. 6a, 6b, and 6c depict the trajectory of image locations for vertical fields of view, V-l, V-0, and V+l . The zigzag pattern remains the same as the vertical field of view, whereas mutual shifts along the y-direction among the patterns are induced by the vertical field of view. The zigzag pattern remains the same for V-l, V-0, and V+l, but shifts progressively along the y-direction, such that the individual patterns overlap each other.
The overlapped zigzag patterns effectively fill the DMD plane. However, one-to-one mapping between the object and DMD is not maintained specifically at the points where each of the zig-zag patterns overlap each other, as shown in Fig. 7. One must then distinguish from what vertical FOV (V0, V+l, V-l) the light comes from.
The problem can be solved by using slice illumination and/or applying an orthogonal light modulation code among each vertical field of view. Figs. 8(a,b,c) show the principle of recovering the one-to-one mapping between horizontal and vertical fields of view to the intermediate image location on the DMD device. The light transmitter consists of an array of light sources. Each light source is a collimated light source scanning a horizontal FOV or a light source collimated in the tangential (vertical) plane and converging or diverging in the
sagittal (horizontal) plane. In either implementation, each light source covers only a limited portion of the vertical FOV. Upon scanning the vertical and horizontal fields of view, the transmitter selectively turns on the illuminating light by which the vertical FOV is selected by the transmitter. Upon receiving light, a portion of the DMD mirror is selectively turned on to select the horizontal FOV.
In another implementation shown in Fig. 8c, each of the light transmitters is modulated in an orthogonal manner.
Lidar may be implemented by a control and measurement system as shown in Fig. 9. In the case of a diode array scanner, for example, a controller activates the laser diode of the array to select the vertical FOV. The laser diodes are turned on by a timing pulse created by the controller. The wave shape of the resulting laser pulse advantageously is Gaussian for a time-of-flight based distance measurement. Alternatively, a modulated pulse shape may be used. At the same time, the controller drives the DMD to select the horizontal FOV by turning on the corresponding pixel(s). The reflected laser light from an object is detected by the detector. The detected signal is compared with the timing pulse. For time of flight measurement, the delay of the detected pulse with respect to the timing pulse is measured. Alternatively, a correlation operation as a function of delay time measured with respect to the timing pulse is carried out for the modulated pulse shape. The time delay provides distance information for the vertical FOV by selection of the illumination source, and selection of the pixel(s) of the DMD. The horizontal scanning operation is repeated for the full vertical and horizontal FOVs of the system.
Claims
1. An optical scanning device, comprising:
an objective lens having an optical axis;
a controllable pixelated light modulator having a plurality of individual pixel elements and a lateral dimension, disposed along the optical axis on an image side of the objective lens, wherein a direct field of view of the optical scanning device is set by said lateral dimension;
a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, such that a wide angle point on an object side of the objective lens is mapped to a respective pixel of the pixelated light modulator;
a controller coupled to the pixelated light modulator in a manner to selectively control any of a plurality of selected arrangements of the pixel elements so as to map the point on the object side of the objective lens to a single point on an image side of the objective lens; and
a detector disposed so as to produce a signal representative of the intensity of light emitted from one or more points in front of the objective lens as the controller selectively controls the pixelated light modulator.
2. The scanning device of claim 1, wherein the pair of lateral reflective surfaces have respective substantially-flat reflective surfaces that are disposed substantially parallel to one another.
3. The scanning device of claim 1, wherein each one of the pair of lateral reflective surfaces are tilted from between zero to 10 degrees.
4. The scanning device of claim 1, wherein the controllable pixelated light modulator is a digital micromirror device (DMD).
5. The scanning device of claim 1, wherein the controllable pixelated light modulator is a liquid crystal display (LCD).
6. The scanning device of claim 1, wherein the controllable pixelated light modulator is a grating light valve (GLV).
7. The optical scanning device of claim 1, further comprising a one dimensional focusing element disposed so as to focus tangential rays reflected from the pixelated light modulator.
8. The optical scanning device of claim 7, wherein the one dimensional focusing element is a cylindrical lens.
9. The optical scanning device of claim 1, further comprising an array of roof mirrors disposed between the pixelated light modulator and the detector, wherein sagittal light rays from the pixelated light modulator are guided to the detector.
10. The optical scanning device of claim 1, further comprising an optical path selector disposed between the objective lens and the micro-mirror array to map individual micro- mirrors both to a corresponding point in front of the objective lens and to the single point in back of the objective lens.
11. The optical scanning device of claim 10, wherein the optical path selector is a beam splitter.
12. The optical scanning device of claim 10, wherein the optical path selector is a frustrated total internal reflection prism.
13. The optical scanning device of claim 1, further comprising a scanner illumination source modulator adapted to modulate the scanner illumination and a demodulator coupled to the detector to demodulate the light directed to the detector by the pixelated light modulator wherein a transit delay of a modulation envelope from the illumination source to the detector can be used to determine a distance of the scanning device from an illuminated object.
14. An optical scanning method, comprising:
providing a controllable pixelated light modulator having a plurality of individual pixel elements and a lateral dimension that determines a direct object side scanning field;
providing a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted in a sagittal plane;
imaging light from one or more points in the object side scanning field onto the pixelated light modulator by reflection from the pair of reflective surfaces , the shape,
position and dimensions of which establish an indirect scanning field; and selectively controlling any of a plurality of selected arrangements of the pixel elements so as to map one or more points in the direct scanning field and the indirect scanning field to a single point in an image side a detection field.
15. The optical scanning method of claim 14, further comprising illuminating the one or more points in the object side of the objective lens with light so as to cause light to be emitted from those points and received at the single point on the image side of the objective lens.
16. The optical scanning method of claim 15, further comprising modulating the illuminating light, demodulating the light received at the single point on the image side of the
objective lens, and determining a transit delay of the modulation envelope from the source of light to a detector to determine the distance of the scanning device to one or more of the points in the object side of the objective lens.
17. A laser range finder, comprising:
an objective lens having an optical axis, an object side, and an image side;
a controllable pixelated light modulator disposed along the optical axis on the image side of the lens; and
a detector disposed optically downstream from the pixelated light modulator on the image side of the lens.
18. The laser range finder of claim 17, wherein the pixelated light modulator has a lateral dimension that determines a direct object side field of view (FOV) of the laser range finder.
19. The laser range finder of claim 18, further comprising a pair of reflective surfaces disposed in opposed tangential planes on opposite sides of the optical axis between the objective lens and the pixelated light modulator and tilted with respect to a sagittal plane, wherein at least one of a shape, a position, an orientation, and a dimension of which establish an indirect FOV of the laser range finder.
20. The scanning device of claim 17, wherein the controllable pixelated light modulator is a digital micromirror device (DMD).
21. The scanning device of claim 17, wherein the controllable pixelated light modulator is a liquid crystal display (LCD).
22. The scanning device of claim 17, wherein the controllable pixelated light modulator is a grating light valve (GLV).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15/756,290 US10281262B2 (en) | 2015-08-31 | 2016-08-19 | Range-finder apparatus, methods, and applications |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201562212525P | 2015-08-31 | 2015-08-31 | |
| US62/212,525 | 2015-08-31 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2017040066A1 true WO2017040066A1 (en) | 2017-03-09 |
Family
ID=58187946
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2016/047767 Ceased WO2017040066A1 (en) | 2015-08-31 | 2016-08-19 | Range-finder apparatus, methods, and applications |
Country Status (2)
| Country | Link |
|---|---|
| US (1) | US10281262B2 (en) |
| WO (1) | WO2017040066A1 (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3428687A1 (en) * | 2017-07-14 | 2019-01-16 | Veoneer Sweden AB | A vision system and vision method for a vehicle |
| WO2019084130A1 (en) * | 2017-10-25 | 2019-05-02 | Bae Systems Information And Electronic Systems Integration Inc. | Method and system of digital light processing and light detection and ranging for guided autonomous vehicles |
| WO2019096584A1 (en) * | 2017-11-15 | 2019-05-23 | Osram Gmbh | Distance measurement unit |
| CN109814128A (en) * | 2019-01-23 | 2019-05-28 | 北京理工大学 | The high-resolution fast imaging system and method that time flight is combined with relevance imaging |
| WO2019201515A1 (en) * | 2018-04-19 | 2019-10-24 | Osram Gmbh | Distance-measuring unit |
| WO2020022146A1 (en) * | 2018-07-27 | 2020-01-30 | 京セラ株式会社 | Electromagnetic wave detector and information acquisition system |
| WO2020022147A1 (en) * | 2018-07-27 | 2020-01-30 | 京セラ株式会社 | Electromagnetic wave detection device and information acquisition system |
| CN110940960A (en) * | 2018-09-21 | 2020-03-31 | 宁波舜宇车载光学技术有限公司 | Laser radar scanning system and laser radar scanning method |
| WO2020115856A1 (en) * | 2018-12-06 | 2020-06-11 | 三菱電機株式会社 | Laser radar device |
| EP3622333A4 (en) * | 2017-05-10 | 2021-06-23 | Gerard Dirk Smits | SCAN MIRROR METHODS AND SYSTEMS |
| US11137497B2 (en) | 2014-08-11 | 2021-10-05 | Gerard Dirk Smits | Three-dimensional triangulation and time-of-flight based tracking systems and methods |
| EP3792677A4 (en) * | 2018-05-08 | 2022-06-08 | Kyocera Corporation | ELECTROMAGNETIC WAVE DETECTION DEVICE AND INFORMATION ACQUISITION SYSTEM |
| US11709236B2 (en) | 2016-12-27 | 2023-07-25 | Samsung Semiconductor, Inc. | Systems and methods for machine perception |
| US11714170B2 (en) | 2015-12-18 | 2023-08-01 | Samsung Semiconuctor, Inc. | Real time position sensing of objects |
| US11829059B2 (en) | 2020-02-27 | 2023-11-28 | Gerard Dirk Smits | High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array |
| US12025807B2 (en) | 2010-10-04 | 2024-07-02 | Gerard Dirk Smits | System and method for 3-D projection and enhancements for interactivity |
| US12542890B2 (en) | 2010-10-04 | 2026-02-03 | Voxelsensors Srl | System and method for 3-D projection and enhancements for interactivity |
Families Citing this family (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11237251B2 (en) * | 2016-05-11 | 2022-02-01 | Texas Instruments Incorporated | Lidar scanning with expanded scan angle |
| US10365351B2 (en) * | 2017-03-17 | 2019-07-30 | Waymo Llc | Variable beam spacing, timing, and power for vehicle sensors |
| JP7246151B2 (en) * | 2018-09-26 | 2023-03-27 | 京セラ株式会社 | Electromagnetic wave detector |
| US11709231B2 (en) * | 2018-12-21 | 2023-07-25 | Infineon Technologies Ag | Real time gating and signal routing in laser and detector arrays for LIDAR application |
| CN110441754B (en) * | 2019-07-22 | 2022-08-30 | 中国科学院上海光学精密机械研究所 | Optical receiving device with controllable optical efficiency of subdivided field of view |
| NO346479B1 (en) * | 2020-11-11 | 2022-08-29 | Toerring Invest As | Ranging Detection |
| US11892572B1 (en) | 2020-12-30 | 2024-02-06 | Waymo Llc | Spatial light modulator retroreflector mitigation |
| US12429322B2 (en) | 2022-03-15 | 2025-09-30 | Carlisle Construction Materials, LLC | Locating, measuring, and error-checking system |
| CN114895288B (en) * | 2022-05-10 | 2022-11-15 | 哈尔滨方聚科技发展有限公司 | Laser echo generation system for three-dimensional scene |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6388738B1 (en) * | 1999-03-03 | 2002-05-14 | Asahi Kogaku Kogyo Kabushiki Kaisha | Rangefinder optical system |
| US6515734B1 (en) * | 1999-12-06 | 2003-02-04 | Olympus Optical Co., Ltd. | Exposure apparatus |
| US20050123239A1 (en) * | 2001-11-10 | 2005-06-09 | Samsung Electronics Co., Ltd. | Optical coupling device, method of producing the same, and optical apparatus using the same |
| US20090141336A1 (en) * | 2007-11-30 | 2009-06-04 | Lumination Llc | Projection display devices employing frustrated total internal reflection |
| US8531650B2 (en) * | 2008-07-08 | 2013-09-10 | Chiaro Technologies LLC | Multiple channel locating |
| US20140049783A1 (en) * | 2011-03-17 | 2014-02-20 | Universitat Politècnica De Catalunya | System, method and computer program for receiving a light beam |
-
2016
- 2016-08-19 WO PCT/US2016/047767 patent/WO2017040066A1/en not_active Ceased
- 2016-08-19 US US15/756,290 patent/US10281262B2/en not_active Expired - Fee Related
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6388738B1 (en) * | 1999-03-03 | 2002-05-14 | Asahi Kogaku Kogyo Kabushiki Kaisha | Rangefinder optical system |
| US6515734B1 (en) * | 1999-12-06 | 2003-02-04 | Olympus Optical Co., Ltd. | Exposure apparatus |
| US20050123239A1 (en) * | 2001-11-10 | 2005-06-09 | Samsung Electronics Co., Ltd. | Optical coupling device, method of producing the same, and optical apparatus using the same |
| US20090141336A1 (en) * | 2007-11-30 | 2009-06-04 | Lumination Llc | Projection display devices employing frustrated total internal reflection |
| US8531650B2 (en) * | 2008-07-08 | 2013-09-10 | Chiaro Technologies LLC | Multiple channel locating |
| US20140049783A1 (en) * | 2011-03-17 | 2014-02-20 | Universitat Politècnica De Catalunya | System, method and computer program for receiving a light beam |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US12542890B2 (en) | 2010-10-04 | 2026-02-03 | Voxelsensors Srl | System and method for 3-D projection and enhancements for interactivity |
| US12025807B2 (en) | 2010-10-04 | 2024-07-02 | Gerard Dirk Smits | System and method for 3-D projection and enhancements for interactivity |
| US11137497B2 (en) | 2014-08-11 | 2021-10-05 | Gerard Dirk Smits | Three-dimensional triangulation and time-of-flight based tracking systems and methods |
| US11714170B2 (en) | 2015-12-18 | 2023-08-01 | Samsung Semiconuctor, Inc. | Real time position sensing of objects |
| US11709236B2 (en) | 2016-12-27 | 2023-07-25 | Samsung Semiconductor, Inc. | Systems and methods for machine perception |
| EP3622333A4 (en) * | 2017-05-10 | 2021-06-23 | Gerard Dirk Smits | SCAN MIRROR METHODS AND SYSTEMS |
| US11067794B2 (en) | 2017-05-10 | 2021-07-20 | Gerard Dirk Smits | Scan mirror systems and methods |
| EP3428687A1 (en) * | 2017-07-14 | 2019-01-16 | Veoneer Sweden AB | A vision system and vision method for a vehicle |
| WO2019012085A1 (en) * | 2017-07-14 | 2019-01-17 | Veoneer Sweden Ab | A vision system and vision method for a vehicle |
| WO2019084130A1 (en) * | 2017-10-25 | 2019-05-02 | Bae Systems Information And Electronic Systems Integration Inc. | Method and system of digital light processing and light detection and ranging for guided autonomous vehicles |
| US12130386B2 (en) | 2017-11-15 | 2024-10-29 | Osram Beteiligungsverwaltung Gmbh | Distance measurement unit |
| WO2019096584A1 (en) * | 2017-11-15 | 2019-05-23 | Osram Gmbh | Distance measurement unit |
| WO2019201515A1 (en) * | 2018-04-19 | 2019-10-24 | Osram Gmbh | Distance-measuring unit |
| US12248096B2 (en) | 2018-04-19 | 2025-03-11 | Osram Beteiligungsverwaltung Gmbh | Distance-measuring unit with a detection field subdivided into a plurality of receiver solid angle segments |
| US12072234B2 (en) | 2018-05-08 | 2024-08-27 | Kyocera Corporation | Electromagnetic wave detection apparatus and information acquisition system |
| EP3792677A4 (en) * | 2018-05-08 | 2022-06-08 | Kyocera Corporation | ELECTROMAGNETIC WAVE DETECTION DEVICE AND INFORMATION ACQUISITION SYSTEM |
| WO2020022147A1 (en) * | 2018-07-27 | 2020-01-30 | 京セラ株式会社 | Electromagnetic wave detection device and information acquisition system |
| EP3832274A4 (en) * | 2018-07-27 | 2022-05-04 | Kyocera Corporation | Electromagnetic wave detector and information acquisition system |
| JP7257751B2 (en) | 2018-07-27 | 2023-04-14 | 京セラ株式会社 | Electromagnetic wave detector |
| JP2020016605A (en) * | 2018-07-27 | 2020-01-30 | 京セラ株式会社 | Electromagnetic wave detection device and information acquisition system |
| WO2020022146A1 (en) * | 2018-07-27 | 2020-01-30 | 京セラ株式会社 | Electromagnetic wave detector and information acquisition system |
| US12248072B2 (en) | 2018-07-27 | 2025-03-11 | Kyocera Corporation | Electromagnetic wave detection apparatus and information acquisition system |
| CN110940960A (en) * | 2018-09-21 | 2020-03-31 | 宁波舜宇车载光学技术有限公司 | Laser radar scanning system and laser radar scanning method |
| JPWO2020115856A1 (en) * | 2018-12-06 | 2021-02-18 | 三菱電機株式会社 | Laser radar device |
| WO2020115856A1 (en) * | 2018-12-06 | 2020-06-11 | 三菱電機株式会社 | Laser radar device |
| CN109814128B (en) * | 2019-01-23 | 2020-08-11 | 北京理工大学 | High-resolution rapid imaging system and method combining time flight and associated imaging |
| CN109814128A (en) * | 2019-01-23 | 2019-05-28 | 北京理工大学 | The high-resolution fast imaging system and method that time flight is combined with relevance imaging |
| US11829059B2 (en) | 2020-02-27 | 2023-11-28 | Gerard Dirk Smits | High resolution scanning of remote objects with fast sweeping laser beams and signal recovery by twitchy pixel array |
Also Published As
| Publication number | Publication date |
|---|---|
| US10281262B2 (en) | 2019-05-07 |
| US20180252513A1 (en) | 2018-09-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10281262B2 (en) | Range-finder apparatus, methods, and applications | |
| JP7332210B2 (en) | 3D imaging system | |
| CN107209265B (en) | Optical detection and distance measurement device | |
| KR102352206B1 (en) | Multiple hypothesized LIDAR device range aliasing resilience | |
| US10018724B2 (en) | System and method for scanning a surface and computer program implementing the method | |
| US11561287B2 (en) | LIDAR sensors and methods for the same | |
| KR101785253B1 (en) | LIDAR Apparatus | |
| US12117565B2 (en) | Methods and systems for dithering active sensor pulse emissions | |
| CN114222930A (en) | System and method for photodiode-based detection | |
| KR101785254B1 (en) | Omnidirectional LIDAR Apparatus | |
| CN103975250A (en) | Spatially selective detection using a dynamic mask in an image plane | |
| JP7230443B2 (en) | Distance measuring device and moving object | |
| CN111837055A (en) | Optical device, distance sensor using optical device, and moving object | |
| KR102209500B1 (en) | Lidar apparatus | |
| KR101867967B1 (en) | Polyhedron optical structure for 360˚ laser scanning and 3d lidar system comprising the same | |
| CN110658527A (en) | LiDAR, Autonomous Mobile Robots and Smart Vehicles | |
| CN114690154A (en) | Optical transmitter module, sensor system and method for retroreflector mitigation | |
| JP2020536245A (en) | Full waveform multi-pulse optical distance meter | |
| US20240241225A1 (en) | Eye safe lidar system with variable resolution multi-beam scanning | |
| CN114144698A (en) | Anti-reflection label for laser radar window | |
| KR102350621B1 (en) | Lidar apparatus | |
| KR20200055655A (en) | Lidar sensors and methods for lidar sensors | |
| KR102915225B1 (en) | Light emitting module and lidar | |
| US12372778B2 (en) | Actuators and couplers for scanning mirrors | |
| US20240241236A1 (en) | Dynamic Alignment and Optical Stabilization of Optical Path in an Automotive-Grade LIDAR |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16842580 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 16842580 Country of ref document: EP Kind code of ref document: A1 |