EP3259615A1 - Actuated optical element for light beam scanning device - Google Patents
Actuated optical element for light beam scanning deviceInfo
- Publication number
- EP3259615A1 EP3259615A1 EP16707357.6A EP16707357A EP3259615A1 EP 3259615 A1 EP3259615 A1 EP 3259615A1 EP 16707357 A EP16707357 A EP 16707357A EP 3259615 A1 EP3259615 A1 EP 3259615A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- light beam
- field
- view
- divergence
- scan
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003287 optical effect Effects 0.000 title claims description 24
- 238000001514 detection method Methods 0.000 claims abstract description 41
- 238000000034 method Methods 0.000 claims description 37
- 230000037361 pathway Effects 0.000 claims description 15
- 230000008569 process Effects 0.000 claims description 14
- 238000003860 storage Methods 0.000 claims description 10
- 238000002310 reflectometry Methods 0.000 abstract description 7
- 230000008878 coupling Effects 0.000 description 19
- 238000010168 coupling process Methods 0.000 description 19
- 238000005859 coupling reaction Methods 0.000 description 19
- 230000008859 change Effects 0.000 description 12
- 230000003993 interaction Effects 0.000 description 12
- 230000001276 controlling effect Effects 0.000 description 11
- 230000002596 correlated effect Effects 0.000 description 9
- 238000013507 mapping Methods 0.000 description 7
- 230000003247 decreasing effect Effects 0.000 description 6
- 238000009434 installation Methods 0.000 description 6
- 230000009471 action Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 5
- 230000002093 peripheral effect Effects 0.000 description 5
- 238000009826 distribution Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000002829 reductive effect Effects 0.000 description 4
- 230000000875 corresponding effect Effects 0.000 description 3
- 239000000835 fiber Substances 0.000 description 3
- 230000007246 mechanism Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000011144 upstream manufacturing Methods 0.000 description 3
- 238000007792 addition Methods 0.000 description 2
- 230000000712 assembly Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000000670 limiting effect Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 229920001690 polydopamine Polymers 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000010408 sweeping Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 1
- 239000003795 chemical substances by application Substances 0.000 description 1
- 238000013501 data transformation Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007717 exclusion Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000010454 slate Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 229920000638 styrene acrylonitrile Polymers 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/42—Simultaneous measurement of distance and other co-ordinates
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4817—Constructional features, e.g. arrangements of optical elements relating to scanning
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/497—Means for monitoring or calibrating
Definitions
- TITLE ACTUATED OPTICAL ELEMENT FOR LIGHT BEAM SCANNING DEVICE
- This disclosure relates generally to light beam scanning and, more particularly, to providing images, mapping, etc. of scenes via light beam scanning. Description of the Related Art
- Beam scanning also referred to herein as light beam scanning, includes directing a light beam at an object and determining a distance to the object based on a "time of flight" between an emitter of the light beam and a detector of the reflected light beam.
- the emitter and detector can be included in a common device.
- Light beam scanning can be used to generate an image, 3D map, etc. of one or more portions of a scene, including one or more objects in the scene, by scanning a pulsed light beam over the scene and determining a flight time of the light beam pulses between the device and various parts of the scene.
- generating an image, 3D map, etc. of one or more portions of a scene includes "image mapping" of the one or more portions of the scene.
- a 3D map of an object, scene, etc. includes a 3D "point cloud" of multiple individual points of reflection of light beam pulses off of various surfaces on one or more objects located in a scene.
- a light beam scanning device can, in some cases, emit a pulsed light beam which is "scanned" over a field of view of the device by a “scanner".
- the device can detect and process the various reflected light beam pulses which are reflected from various surfaces located within the field of view and received at a detector to determine the position, within the field of view, of each of the various points on the object from which the light beam pulses were reflected.
- Some embodiments provide an apparatus which includes a light beam scanning device which scans a light beam, within a scan range, over a scene that is within a field of view of the scan range and generates an image map of at least a portion of the scene, based at least in part upon a time of flight of the light beam to and from one or more points within the scene.
- the light beam scanning device can include a lens element assembly which dynamically adjusts a divergence of the light beam.
- the lens element assembly can include multiple lens elements, and one or more of the lens elements can be translated, relative to at least one other of the lens elements and in a direction parallel to a direction of the light beam, to implement dynamic divergence adjustment.
- dynamically adjusting a divergence of the light beam can include adjusting a diameter of the light beam along one or more axes of the light beam.
- the apparatus can include a scanner which scans the light beam, received from the lens element assembly, over a selected field of view of the scan range at one or more scan rates.
- the apparatus can include a controller device which controls the lens element assembly to dynamically adjust the divergence of the light beam as the light beam is scanned over the selected field of view.
- the controller device can adjust the light beam divergence between separate scans of the light beam over at least a portion of the selected field of view, such that the divergence of the light beam is different between at least two consecutive scans.
- the controller device can adjust the light beam divergence during a scan over at least a portion of the selected field of view.
- the controller device controls the lens element assembly and the scanner to initially scan the light beam over a first selected field of view of the scan range at a first scan rate and a first divergence, and subsequently scan the light beam over a second field of view, encompassed within a limited region of the first field of view, at a second scan rate and a second divergence, based at least in part upon a determined time of flight of the light beam to and from at least a point located within the second field of view.
- the light beam scanning device can determine at least a depth, azimuth, and elevation of the portion of the scene, relative to at least a portion of the light beam scanning device, based at least in part upon the time of flight of the light beam to and from the point, and an orientation of the scanner.
- the light beam scanning device can include a detector which receives the light reflected from at least a point within the field of view.
- the detector can include a single-pixel sensor receives the light reflected from at least a point within the field of view at a single sensor element.
- the light beam scanning device can include a light detection and ranging (LIDAR) device.
- LIDAR light detection and ranging
- Some embodiments provide a method which includes dynamically adjusting a divergence of a light beam scanned, by a scanner, over a scene that is within a field of view of a scan range, such that a map of at least a portion of the scene is generated, based at least in part upon a time of flight of the light beam to and from one or more points within the scene.
- dynamic adjustment includes directing the beam of light to be scanned, by the scanner, over a first field of view at a first scan rate and at a first divergence and, based at least in part upon a time of flight of the light beam to and from a particular portion of the scene within the first field of view, directing the beam of light to be scanned, by the scanner, over a second field of view at a second scan rate and at a second divergence, wherein the second field of view encompasses a limited region of the first field of view which includes the particular portion of the scene.
- directing the beam of light to be scanned, by the scanner, over a second field of view at a second scan rate and at a second divergence includes selecting the second scan rate and the second divergence based at least in part upon the time of flight of the light beam to and from the particular portion of the scene within the first field of view.
- dynamically adjusting the divergence of the light beam comprises adjusting a divergence of at least one axis of the light beam, relative to a divergence of at least one other axis of the light beam.
- adjusting the divergence of the light beam comprises adjusting the divergence of at least one axis of the light beam to equal the divergence of at least one other axis of the light beam.
- Some embodiments provide a method which includes configuring a light beam scanning device to scan a light beam having a dynamically-adjustable divergence, within a scan range, over a scene that is within a field of view of the scan range and generate a map of at least a portion of the scene, based at least in part upon a time of flight of the light beam to and from one or more points within the scene.
- Such configuring includes coupling a lens element assembly to at least a portion of the light-beam scanning device, wherein the lens element assembly is configured to adjust the divergence of the light beam.
- providing the lens element assembly in a light- beam scanning device includes coupling the lens element assembly to a location along a pathway of the light beam between a transmitter configured to emit the light beam and a scanner configured to scan the light beam over the field of view of the scan range.
- the lens element assembly comprises a plurality of lens elements, wherein at least one of the lens elements is configured to be adjusted along a directional axis which is parallel to a pathway of the light beam and relative to at least one other of the lens elements to adjust the divergence of the light beam.
- the configuring includes coupling the lens element assembly to a controller device configured to adjust the at least one of the lens elements based at least in part upon a time of flight of the light beam to and from one or more points within the scene.
- the configuring comprises coupling a detector to the light beam scanning device, wherein the detector is configured to receive the light reflected from at least a point within the field of view and generate an output indicating at least the time of flight of the light beam to and from the point, such that the light beam device is configured to: determine at least a depth, azimuth, and elevation of the one or more points within the, relative to at least a portion of the light beam scanning device based at least in part upon the output generated by the detector and an orientation of the scanner; and adjust the divergence of the light beam based at least in part upon the depth, azimuth, and elevation of the one or more points within the scene.
- FIG. 1 illustrates a light beam scanning device which scans light beams over a field of view, according to some embodiments.
- FIG. 2A-B illustrate an emitter which emits a light beam and a lens element assembly which adjusts the divergence of the beam along one or more cross sectional axes of the beam, according to some embodiments.
- FIG. 3A-B illustrate adjusting beam divergence of a sequence of light beam pulses scanned by a light beam scanning device over a field of view in a scan pattern, according to some embodiments.
- FIG. 4 illustrates dynamically adjusting beam divergence to generate variable-resolution image maps of various objects within the field of view of a light beam scanning device, according to some embodiments.
- FIG. 5 illustrates a controller device which can be included in a light beam scanning device, according to some embodiments.
- FIG. 6 illustrates configuring a light beam scanning device to scan a light beam having a dynamically-adjustable divergence within a scan range of the device, according to some embodiments.
- FIG. 7 illustrates dynamically adjusting a divergence of a light beam scanned, by a light beam scanning device, over a field of view that is within a scan range of the light beam scanning device, according to some embodiments.
- FIG. 8 illustrates an example computer system configured to implement aspects of a system and method for light beam scanning, according to some embodiments.
- a unit/circuit/component is “configured to” perform one or more tasks is expressly intended not to invoke 35 U.S.C. ⁇ 112, sixth paragraph, for that unit/circuit/component.
- "configured to” can include generic structure (e.g., generic circuitry) that is manipulated by software and/or firmware (e.g., an FPGA or a general-purpose processor executing software) to operate in manner that is capable of performing the task(s) at issue.
- "Configure to” may also include adapting a manufacturing process (e.g., a semiconductor fabrication facility) to fabricate devices (e.g., integrated circuits) that are adapted to implement or perform one or more tasks.
- this term is used to describe one or more factors that affect a determination. This term does not foreclose additional factors that may affect a determination. That is, a determination may be solely based on those factors or based, at least in part, on those factors.
- a determination may be solely based on those factors or based, at least in part, on those factors.
- Some embodiments provide an apparatus which includes a light beam scanning device which can be used to generate image maps of various objects and scenes within a scan range of the device, where the device is configured to at least partially adjust the divergence of a light beam, such that a cross sectional area of the beam, also referred to herein as a "beam spot", is adjusted along the distance travelled by the beam.
- Adjusting the beam spot size can include adjusting the beam divergence such that the beam spot of the beam at a given distance from the emitter is adjusted in one or more of size, shape, some combination thereof, etc.
- the size of the cross sectional area of a beam can be referred to as the beam spot size of the beam.
- beam divergence adjustment can be referred to interchangeably as beam spot size adjustment.
- Adjustment of the beam spot size of a light beam which is scanned over at least some portion of a scan range can enable the apparatus to adjust the scanned beam between a wide- divergence beam, which can be scanned over a field of view to detect objects in the field of view, and a narrow-divergence beam, which can be scanned over a limited region of the field of view in which the detected objects are located to generate a detailed point cloud of the detected objects.
- a narrow-divergence beam includes a relatively smaller beam spot size of the beam at a given distance of travel, relative to a wide-divergence beam, such that the beam spot size of a wide-divergence beam is relatively larger, at a given distance of beam travel, than that of a narrow-divergence beam.
- the apparatus can initially scan a field of view via a wide-divergence beam, to initially detect objects within the field of view, and subsequently scan limited regions of the field of view, in which the detected objects are located, via a narrow-divergence beam. Beam divergence adjustment can enable adjustment of the intensity of the reflection point, enabling detection of objects with relatively low reflectivity.
- An image map can include a two-dimensional (2D) image of a scene, a three-dimensional (3D) image mapping of a scene, some combination thereof, or the like.
- the device can direct a light beam, can include a sequence of light beam pulses (referred to herein as a "pulsed light beam"), out from the device into a field of view of the device.
- the light beam can travel out from the device and into the field of view, where the beam can be reflected off of one or more points (herein “reflection points") on various surfaces within the field of view and travel back, as a reflected beam to a detector included in the device.
- the detector can receive the reflected light beam, detect the reflected beam, and generate an output associated with the detection.
- Detection of a reflected beam which is reflected off of a reflection point in the field of view can comprise detection of the reflection point itself.
- Such an output can include a determined time that the reflected beam is detected, an intensity of the detected reflected beam, a travel time (also referred to herein as “flight time”, “time of flight”, etc.) of the light beam to between the device and the reflection point, a position of the reflection point within the field of view of the device, some combination thereof, etc.
- the position of the reflection point within the field of view can include a determined range (also referred to herein as "depth”, "distance”, etc.) of the reflection point from the device, which can be determined based on the flight time of the beam between the device and the reflection point.
- the position of the reflection point can include an angular position of the reflection point within the field of view.
- Such an angular position can be expressed as an azimuth (horizontal angle from the center of the device field of view) and an elevation (vertical angle from the center of the device field of view).
- a "light beam” includes a laser beam which can be emitted by a laser light source.
- the laser beam can be collimated and directed in one or more particular directions.
- the light beam scanning device includes one or more light collimating elements, which can be included in one or more lens elements, which controllably adjust a spatial mode of the light beam.
- the collimated light beam which can be a collimated laser beam, can exhibit coherence along the collimation range.
- one or more position properties (depth, azimuth, elevation, etc.) of reflection points detected in a field of view can be determined based at least in part upon properties of elements of the light beam scanning devices other than the detector.
- the azimuth and elevation of the reflection point detected at detector can be determined based at least in part upon the azimuth and elevation to which a scanner device in the light beam scanning device is positioned to direct light beam pulses concurrently with at least a portion of the time during which the light beam travels between the device and the reflection point.
- reflected beam intensity is included in the generated output as a property of the reflection point.
- reflection point depth is determined based at least in part upon one or more of reflection point intensity, reflection point size, reflection point shape, etc. For example, where a reflection point is determined, based on detection of a reflected light beam from the reflection point, to have a relatively large surface area and low intensity, the reflection point can be determined to have a relatively large depth within the field of view. It will be understood that the position of the reflection point can include various position properties of the reflection point, including coordinates of the reflection point within the field of view.
- the device can direct the pulses to travel in different directions (e.g., different azimuths and elevations relative to a center of the field of view) from the device within the field of view.
- the device can include a scanner device, also referred to herein as a "scanner", which can direct different light beam pulses to travel in different directions within the field of view.
- the scanner directs light beam pulses to travel in different directions within a field of view which is smaller than, and included within, the maximum field of view of the device.
- a maximum field of view can be based on physical limitations of the scanner and can be referred to as the "scan range" of the scanner, the "scan range” of the device, etc.
- the scanner in some embodiments, includes a reflective device, including a mirror, which can be adjusted, based at least in part upon an action of an actuator device associated with the scanner, to different orientations to cause the light beam pulses received from an emitter device to be reflected into different directions of travel, thereby directing the beam pulses into different directions within the field of view.
- the light beam pulses can be directed to travel into different regions of the field of view, reflect off of different points on various surfaces in the field of view, and return to the detector in the device.
- the reflected beams received at the device are directed to the reflector by at least the scanner.
- the device can detect reflection points, and positions thereof, in various different regions of the field of view.
- the light beam scanning device can monitor various properties of various detected reflection points (e.g., depth, azimuth, elevation, intensity, some combination thereof, etc.) and, based on similarities in one or more properties between various reflection points, correlate the various reflection points to one another to generate a point "cloud" of reflection points which represent a point cloud of an object located within the field of view.
- the generated point cloud can be used to generate a 3D map of the object, an image of the object, track the object in the field of view, etc.
- a light beam cross section also referred to herein as the "beam spot" changes with distance from the emitter of the beam.
- a light beam cross-sectional area can grow with distance traveled. Such growth can be due to a divergence of the beam.
- divergence of the light beam refers to an angular measure of the increase of one or more dimensional properties of the beam cross section, including one or more of beam radius, diameter, some combination thereof, etc. in one or more cross sectional axes as the beam travels away from one or more of a light beam emitter, optical aperture, optical lens, some combination thereof, etc.
- the light beam can be a laser beam
- the beam can exhibit divergence along one or more axes of the beam cross section as the beam travels away from the light beam emitter, which can include one or more laser diodes. Where divergence is approximately equal in value across all cross-sectional axes, the beam cross section can grow larger with travel distance of the light beam from the emitter, with corresponding decrease in overall light beam intensity.
- a light beam can have an asymmetric emission, such that the beam has a fast axis and a slow axis, where the divergence of the fast axis is greater than that of the slow axis.
- a cross-sectional area can change shape and size over distance travelled. For example, where an initially-emitted light beam has a circular cross-section, the light beam can become more elliptical in shape with distance travelled from the emitter, as the divergence of the fast axis of the beam can be greater than that of the slow axis of the beam.
- Such a deformed beam can result in inaccuracies in determining the position of reflection points in a scene. Such inaccuracies can be exacerbated with distance between the scanning device and various objects in the field of view, thereby complicating efforts to generate accurate imaging of a scene via light beam scanning of a field of view.
- a light beam has different divergence values across different axes of the beam cross-section.
- the beam can have a fast axis which exhibits a certain value of divergence and a slow axis which exhibits a different value of divergence which is less than that of the divergence of the fast axis.
- the shape of the beam cross section can change, in addition to size.
- the beam cross section can change shape from circular to ellipsoid with increasing travel distance, as the diameter of the beam spot along the fast axis can become progressively larger with respect to the diameter of the beam spot along the slow axis.
- a beam with a relatively large (“wide”) beam divergence can exhibit a relatively large beam spot.
- Such a wide-divergence beam spot encompassing a relatively large region of the field of view and also referred to herein as a large beam spot size, can be more likely than beam spots of narrower-divergence beams, where beam spots of narrower-divergence beams can be smaller in spot size than the beam spot of a wider-divergence beam at a common distance of beam travel, to reflect off of a surface of one or more objects located in the field of view.
- scanning a relatively wide-divergence beam through a field of view can be relatively more likely to result in detection of one or more reflection points, and thus objects, in the field of view. While wide-divergence beams can be more likely to result in object detection in a field of view, the resolution of a point cloud of the object generated based on detected reflection points may be less than that of a point cloud generated based on detected reflection points which result from scanning a narrower-divergence beam over the object.
- a beam with a relatively small (“narrow”) beam divergence can exhibit a relatively small beam spot.
- a narrow-divergence beam spot encompassing a relatively small region of the field of view, can be more likely than beam spots of wider-divergence beams to reflect off of different detailed surfaces of one or more objects located in the field of view.
- scanning a relatively narrow-divergence beam through a field of view can be relatively more likely to result in generating a point cloud of an object which resolves various details and features of the object in the field of view, relative to scanning a wider-divergence beam through the field of view.
- the likelihood of detection of an object in the field of view via a narrow-divergence beam may be less than the likelihood of detection of an object via a wider-divergence beam scanning.
- the apparatus can include a lens element assembly which can adjust divergence of the light beam along one or more cross sectional axes of the beam.
- the lens element assembly included in the light beam scanning device can control divergence of the beam along one or more cross-sectional axes.
- cross sectional axis is an axis which is perpendicular to the optical axis of the light beam. Divergence control can result in improved accuracy of determining the position of reflection points in the field of the view of the device, which can result in more accurate images, 3D maps, etc. generated based on the reflection points.
- different beam pulses of the light beam can change to different cross sectional shapes based on the distance traveled to and from various surfaces in the field of view: pulses which reflect off of nearby surfaces may remain approximately circular in cross section, while pulses which reflect off of distance surfaces may be highly ellipsoid.
- Controlling beam divergence can at least partially mitigate such non-uniformity of beam pulse cross sections, which can improve the accuracy of the device in determining the properties of reflection points detected at various positions within the field of view (e.g., at various distances from the device), which can improve the correlation of various sets of reflection points into point clouds of various objects, etc.
- image mapping accuracy is enhanced, resulting in images, 3D maps, etc. which have improved accuracy in mapping the various objects in the scene that is within the field of view.
- the lens element assembly can control beam divergence, thus controlling beam spot size, along one or more cross-sectional axes to control the beam spot size of the beam, thereby adjusting the beam to optimize between object detection and high-resolution object point cloud generation.
- the lens element assembly can control the beam divergence to cause a beam scanned over a field of view to initially have a wide divergence and a resulting large beam spot size, thereby optimizing a scan of the beam to result in detecting objects in the field of view, and subsequently to have a narrow divergence, thereby optimizing a scan of the beam to result in resolving detailed point clouds of the detected objects in the field of view.
- the field of view can be adjusted based on object detection via a wide-divergence beam scan, such that a narrow-divergence beam is scanned over a limited region, of the initial field of view, in which an object is initially detected via a wide-divergence beam scan.
- FIG. 1 illustrates a light beam scanning device 100 which scans light beams over a field of view, according to some embodiments.
- Device 100 can include a light detection and rangefinding ("LIDAR") device.
- LIDAR light detection and rangefinding
- Device 100 includes a light emitter 102 which emits a light beam 103.
- the emitter 102 can emit the light beam as a sequence of beam pulses, also referred to herein as a pulsed light beam.
- the emitter 102 can be a laser light source, also referred to herein interchangeably as a laser emitter, laser light emitter, etc.
- the emitter 102 includes one or more laser diodes.
- the light emitter 102 is a laser light source which includes a vertical cell external cavity laser (VCSEL) emitter.
- VCSEL vertical cell external cavity laser
- a light beam emitted by a VCSEL emitter is independent of asymmetrical emission, such that the emitted beam does not include a fast axis, slow axis, etc.
- the light emitter 102 includes a fiber laser emitter which emits a light beam which is a laser beam having a Gaussian beam profile, which results in the beam having a cross-sectional intensity distribution which approximates a Gaussian profile.
- the emitter 102 includes an edge-emitting solid state laser emitter.
- An edge-emitting solid state laser emitter can emit a laser beam which exhibits asymmetric emission, such that the beam exhibits an elliptical cross-sectional area which includes a fast axis and a slow axis.
- Such a beam can, in some embodiments, be at least partially polarized.
- the light emitter as described herein can encompass any known laser light source.
- a cross-sectional area, distribution, etc. with regard to a light beam can be referred to interchangeably as a transverse area, transverse distribution, etc.
- Device 100 includes a scanner 108 which directs the light beam 103 in various directions over a field of view 112. Such directing the light beam 103, various pulses included therein, etc. over various regions of a field of view can be referred to as “sweeping" the beam over the field of view, “scanning” the beam over the field of view, etc.
- the scanner 108 can "scan" the beam over the field of view in one or more particular scan patterns, so that the beam, pulses therein, etc. are directed across various regions of the field of view in a particular pattern across the field of view.
- the scanner 108 can include a reflective device, including a mirror, which can be controllably adjusted to various orientations so that the light beam 103 is directed to travel in various controlled directions within the field of view 112.
- the scanner 108 can be controllably adjusted to various orientations, to direct the light beam 103 to travel in a particular direction, based on an actuator device associated with the scanner 108.
- the field of view 112 of the device 100 can be based at least in part upon the range of directions in which the scanner 108 can direct light beams received from emitter 102.
- Device 100 include an optical aperture 110 through which the light beam travels, as directed beam 105, from the scanner 108 out into an external environment 101.
- the field of view 112 of the device 100 can be based at least in part upon the optical aperture 110.
- the directed light beam 105 travels, within a particular region of the field of view 112 based at least in part upon the orientation of the scanner 108, and reaches a surface of an object 120 located within the field of view 112.
- the light beam 105 can reach a particular point 122 on the object, thereby illuminating the point 122.
- At least a portion of the beam 105 which reaches the point 122 can reflect off of the point 122 as a reflected beam 107.
- the reflected beam 107 can return to the device 100.
- the point 122 can be referred to as a "reflection point".
- the reflection point 122 has a size and shape which corresponds to the beam spot of the light beam 105 which reaches the object 120 and reflects off of point 122.
- the size of point 122 can be relatively larger in area than if beam 105 were a narrow- divergence beam with a relatively small beam spot size.
- the device includes a detector 114 which can detect the reflection point 122 based on receiving the reflected beam 107.
- the device 100 includes a beam splitter 106 and directs the reflected beam 107 to reach the detector via the scanner 108 and the beam splitter 106.
- the beam splitter 106 is absent and the reflected beam 107 reaches the detector 114 via a pathway which is at least partially separate from the pathway followed by the beam 103, 105 via the scanner 108.
- the detector 114 can be located proximate to a separate optical aperture and can directly detect reflected beams 107 which reach the separate optical aperture.
- the detector includes a single sensing element which can detect a reflected beam 107.
- the detector 114 can be a single-pixel detector.
- the detector 114 can detect the reflection point based at least in part upon detecting the reflected light beam 107 received at the detector 114.
- the detector can determine a travel time of the beam between at least the device 100 and the reflection point 122 and can therefore determine the position of the reflection point 122, relative to the device 100.
- the detector can determine a travel time of the beam to reflection point 122 based on a time of emittance of the pulse at emitter 102 and a time of receiving the reflected beam pulse 107 at the detector 114.
- the distance traveled by beam 103 within device 100 (e.g., from emitter 102 to scanner) the distance traveled by beam 107 within device 100 (e.g., from scanner 108 to detector 114 may be predetermined, such that the travel time corresponding to such distances of travel within device 100 can be discounted from the elapsed time between beam emittance at emitter 102 and reception at detector 114 to determine the travel time of the light beam between the scanner 108, optical aperture 110, etc. and the reflection point 122.
- device 100 can determine the distance ("depth") of the reflection point within the field of view 112.
- depth the distance of the reflection point within the field of view 112.
- the position of the reflection point in three dimensions within the field of view 112 can be determined.
- the position of the reflection point 122 can be determined as a particular depth 154, azimuth 152, and elevation (orthogonal to azimuth 152) relative to the position of the scanner 108, based on the travel time of the beam to and from the reflection point 122 and the orientation of the scanner concurrently with the beam travelling to and from the point 122.
- the device 100 generates a point "cloud" of an object 120 based on a correlation of the detected reflection points 122 on one or more surfaces of the object.
- the scanner 108 adjusts to direct beam 103 pulses to reflect off of various points 122 on the object 120 at various azimuths 154 relative to a center 151 of the field of view 112 and elevations (angular difference from 151 along an axis orthogonal to azimuth 152, i.e. in a direction out of the figure), such that the various reflection points 122 are detected by detector 114, the device 120 can correlate the various reflection points 122 on the object to generate a point "cloud" of the object 120.
- the correlated points 122 may be correlated based on similarities in properties, relative to other points 122 in the field of view 112. For example, a set of points 122 with similar depth 154, azimuth 152, and elevation properties may be determined to be points on one or more surfaces of a common object 120 and can be correlated into a point cloud of the object, relative to other reflection points with different properties, including different depth, azimuth, and elevation properties. In another example, a set of point 122 with similar intensity may be determined to be points on one or more surfaces of a common object 120 and can be correlated into a point cloud of the object, relative to other reflection points with different intensities.
- Device 100 includes a lens element assembly 104 which adjusts divergence of the beam 103.
- the lens element assembly 104 can be located along an optical pathway of the light beam 103 through the device, between the emitter 102 and the optical aperture 110.
- the lens element assembly 104 can be located between the emitter 102 and the scanner 108, although it will be understood that the assembly 104 can be located in other locations in the device, including between the scanner 108 and the aperture 110, between the scanner and a beam splitter, etc.
- Multiple separate assemblies 104 can be located along the optical pathway of one or more of the beam 103, 105, etc.
- the assembly 104 can adjust the divergence of the light beam in one or more particular cross sectional axes of the light beam. Adjusting divergence of the light beam can result in adjusting the beam spot size of the light beam. For example, the assembly 104 can adjust the divergence of a particular axis, including a fast axis of the light beam 103, relative to a divergence of another particular axis, including a slow axis of the light beam 103. Such adjustment can result in uniform divergence of the beam 103 "downstream" of the assembly 104, relative to the beam 103 "upstream" of the assembly.
- Uniform beam divergence can result in a beam spot of the beam 103 which is approximately uniform in radius, or circular in shape. Uniform beam divergence can result in improved accuracy of reflection point correlation into point clouds of objects, as the shape of the reflected beam 107 received at the detector 114 can exhibit increased uniformity in shape across various distances of the reflection point 122 in the field of view 112. Such uniformity of the beam 107 cross section can enable the device 100 to more accurately determine properties of the reflection points 122 and distinguish whether to correlate certain sets of reflection points 122 into one or more point clouds.
- assembly 104 dynamically adjusts the divergence of beam 103, such that the scanned beam 105 has a particular cross sectional area, intensity, etc.
- Such dynamic adjustment can be implemented based on the size of the field of view 112, the determined depth of one or more detected reflection points 122 relative to the device 100, a predetermined scan protocol, etc.
- emitter 102 and scanner 108 are controlled to implement multiple successive scans of a field of view 112
- the scanner 108 "scans" the light beam 105 across one or more regions of the field of view 112 in a scan pattern
- assembly 104 can adjust the beam 105 divergence between consecutive scans of the field of view.
- one scan can involve scanning a wide-divergence beam over the field 112, where the cross sectional area of the beam is relatively increased at various depths from the device 100, relative to a reference divergence value, and a next scan can include scanning a narrow-divergence beam over the field.
- Such consecutive scans can scan in a common pattern over the field 112.
- a scan can include directing the sequence of pulses in a pattern across the field 112.
- the first scan of the beam having a wider divergence, results in a pattern of pulses which have a wider beam cross section and are more likely to reach a surface of an object 120 in the field, relative to a pattern of beam pulses having narrower divergence which might "miss" an object 120 in the field 112.
- the second scan of the beam having a narrower divergence, results in a pattern of pulses which have a narrower beam cross section and greater intensity and are thus more likely to reflect sufficiently intense light 107 off of a surface to be detected at detector 114, thereby allowing detection of reflection points 122 on objects with relatively low reflectivity.
- dynamic divergence adjustment includes adjusting beam divergence, beam spot size, etc. during a given scan of a field of view 112, such that beam divergence is at least partially changed, while the emitter 102 and scanner 108 are in the process of scanning a field of view 112 in one or more particular scan patterns.
- Such dynamic adjustment can be implemented in response to detection of one or more reflection points 122 in the field of view 112.
- device 100 adjusts the field of view through which the scanner 108 scans the light beam 105, based at least in part upon detection of one or more reflection points 122 in the field of view. Such adjustment can result in scanning particular regions of the field of view in which objects are determined to be located.
- field of view 112 can represent a maximum field of view through which scanner 1008 can scan the light beam 105. Such a maximum field of view can be referred to as the scan range of the device 100.
- the scanner 108 can scan the beam 105 through the field of view 112 and, in response to detecting reflection point 122, the device 100 can adjust the field of view through which the scanner 108 scans the beam 105 from the maximum field of view 112 to another field of view 132 which represents a limited region of the field of view 112.
- the field of view 132 can be determined based on the detection of the reflection point 122, so that the field of view encompasses a limited region of field 1 16 in which an object 120 which includes point 122 is located.
- scans of the beam 105 can focus on detecting reflection points from various locations on the object 120, which can enable device 100 to generate a higher-fidelity point cloud of the object 120.
- the device 100 can adjust the rate ("scan rate") at which the scanner 108 changes orientation to scan the light beam 105 across the field of view based on the size of the field of view 132.
- the scan rate can include a rate of orientation change of the scanner 108, a value associated with the magnitude of the individual step changes in scanner orientation between consecutive sets of beam pulses, etc.
- scanner 108 may be required to execute relatively large steps in orientation change between directing different sets of beam pulses to separate regions of the field 112. Where the scanner 108 is controlled to scan a smaller field of view 132, the scanner can execute smaller steps in orientation change between directing different sets of beam pulses to separate regions of the field 132.
- the scan rate of the scanner 108 can be decreased, so that the angle change between separate sets of beams 105 in a given scan of the field 132 are correspondingly decreased, which can result in higher-resolution point clouds of an object 120 in the field, as the point cloud can include more points 122.
- assembly 104 dynamically adjusts beam divergence based on detection of one or more reflection points 122 in the field of view 112, where the adjustment is based at least in part upon the size of the field of view 132, the depth of the reflection point 122 relative to the device, some combination thereof, etc.
- the divergence of a beam can be decreased so that the beam cross sectional area at the object 120 is also decreased, resulting in smaller reflection points 122 on the object and increased detail of the object in a generated point cloud.
- the divergence can be increased so that the regions of the field scanned by the beam 105 are increased to reduce a probability that an object 120 in the field is completely missed by the beam 105. While the resolution of the object 120 may be reduced via increased beam 105 divergence, the divergence can be adjusted dynamically during a scan, between consecutive scans, etc.
- a field of view can be first scanned with a wide-divergence beam to first detect the presence of objects 120 in various particular regions of the field 112 (referred to herein as "coarse scanning”, “sensing”, etc.) and then scanning one or more limited regions of the field 112 via a narrow-divergence beam at a lower scan rate, to generate a higher-resolution point cloud of the object which resolves various details of the object.
- the divergence of the beam can be dynamically selected and adjusted thereto based on one or more of the field of view 132, determined depth of a detected reflection point 122 in the field 132, a determined scan rate of the scanner 108, some combination thereof, etc.
- Device 100 includes a controller 150, which can also be referred to herein as a "controller device".
- controller 150 controls one or more of the above elements of device 100 to implement image mapping of a field of view 112.
- controller 150 can control the emitting of a pulsed light beam by emitter 102, control scanner 108 to control scanning of one or more fields of view included within the scan range 112, control assembly 104 to control beam divergence, etc.
- Controller can control one or more elements of device 100, including assembly 104, scanner 108, etc. based on output data generated by detector 114, input data received from a user of device 100 via one or more user interfaces of device 100, etc.
- the controller 150 controls one or more of the elements of device 100, including adjusting a position of one or more portions of lens element assembly 104, via an open loop control process.
- the controller can access a stored relationship between a particular beam divergence, beam spot size, etc. and a particular position of one or more portions of the lens element assembly and, based at least in part upon determining a target beam spot size, beam divergence, some combination thereof, etc., the controller can adjust one or more portions of the lens element assembly 104 to a particular position which is determined to be associated with the target beam spot size.
- the controller 150 controls one or more of the elements of device 100, including adjusting a position of one or more portions of lens element assembly 104, via a closed loop control process.
- the controller can, based at least in part upon determining a target beam spot size, determine an initial adjustment to a portion of the lens element assembly, to a particular position, which is determined to adjust the beam spot size to match the target beam spot size adjust a portion of the lens element assembly 104 to a particular position, implement the initial adjustment of the lens element assembly portion, subsequently determine the beam spot size of the beam as feedback, determine a new adjustment to the lens element assembly which is determined to adjust the beam spot size to match the target beam spot size based on the beam spot size feedback, etc.
- FIG. 2A-B illustrate an emitter which emits a light beam and a lens element assembly which adjusts the divergence of the beam along one or more cross sectional axes of the beam, according to some embodiments.
- the illustrated emitter and lens element assembly can be included in any of the above embodiments.
- a lens element assembly includes multiple lens elements which can be adjusted, individually, collectively, some combination thereof, etc. to adjust the divergence of the light beam.
- the lens element assembly can include one or more actuator mechanisms, also referred to herein as "actuators", which adjust one or more of the lens elements.
- light emitter 202 emits a light beam 201, which can include a laser beam, along an optical axis 226, and lens element assembly 204 includes a first lens element 206, a second lens element 208, and an actuator 207, where at least one of the elements 206, 208 can be adjustably positioned ("adjusted") by actuator 207 to adjust the divergence of the beam 201 along one or more cross sectional axes 222, 224 of the beam 201. At least one of the lens elements can at least partially collimate the beam 201. For example, lens element 206 can at least partially collimate the beam 201.
- one or more portions of the lens element assembly includes an actuated optical element which can condition a light beam, such that the spot size of the light beam, reflection spot size, etc. is adjustably controlled.
- the actuated optical element includes an actuated beam expander lens assembly which can adjustably control the diameter of the light beam spot size.
- Actuator 207 can include one or more various actuators.
- actuator 207 can include one or more magnetic actuators, voice coil motors, bi-stable actuators, etc.
- actuator 207 can re-position a lens element between two or more discrete positions.
- actuator 207 can include a bi-stable actuator which can adjustably position a lens element at one of two discrete positions.
- actuator 207 can continuously reposition a lens element along a range of continuous positions.
- actuator 207 can include a voice coil motor actuator which can adjustably position a lens element along a range of continuous positions. It will be understood that the actuator 207 can encompass any known actuator mechanism.
- lens elements 206, 208 span transverse to optical axis 226.
- One or more of elements 206, 208 can be adjusted along the optical axis 226 to adjust beam divergence in one or more of the cross sectional axes 222, 224.
- lens element 208 is positioned at a particular distance 212A from lens element 206, which can be fixed in a particular position relative to emitter 202.
- the beam 201 passing downstream from assembly 204 can exhibit a divergence 240A in a cross sectional axis 222 which corresponds to the fast axis of the beam 201.
- the cross section 250A of the beam 201 also referred to herein interchangeably as the beam spot 250A, at a distance 214A downstream of the lens element 208 has become ellipsoid rather than circular 252A, due to the divergence of the fast axis 222 and the slow axis 224, where slow axis is orthogonal to both axis 226 and axis 222.
- the cross section 222, or "beam spot" 222 extends along axes 222, 224 which are both orthogonal to each other and to optical axis 226 along which the beam 201 travels.
- lens element 208 is adjusted to a new position which is at a particular distance 212B from lens element 206, where distance 212B is greater than that of distance 212A.
- the divergence 240B of the beam 201 is increased along at least the fast axis 222, resulting in a beam cross section 252B, at distance 214B from lens element 208, which has a greater area than that of the cross section 252A.
- distances 214A and 214B are located the same distance from a fixed element, including emitter 202, lens element 206, and assembly 204 as a whole, although distances 214A and 214B may not be equal, due to the adjusted position of the lens element 208.
- lens element 208 is adjustable to adjust the divergence 240 A-B of the beam 201 along some or all cross sectional axes of the beam 201, so that the cross sectional area of the beam 201 is adjusted across a range of depths from the assembly 204, although the beam cross section increasingly diverges from circular to ellipsoid with increasing distance downstream from the assembly 204.
- Such adjustment of element 208 can be implemented by actuator 207.
- Such adjustment can be dynamic.
- Such adjustment can include translating one or more lens elements.
- one or more of the lens elements in the assembly 204 is adjustable to adjust divergence in one or more particular cross sectional axes, relative to divergence in one or more other particular cross sectional axes, so that the shape of the beam 201 can be controlled across a range of distances downstream from the assembly 204.
- lens element 208 is adjustable in distance from lens element 206 to adjust a divergence of the fast axis 222, relative to ta divergence of the slow axis 224, such that the cross section of the beam 201 maintains a generally circular shape 252A across a range of distances from the assembly, where not doing so could result in ellipsoid cross sections 250A across the same range.
- the element 208 can be translated, relative to element 206, to control both size and shape of the beam cross section 250B, also referred to herein interchangeably as the beam spot 250B, so that the cross section is increased, at a given distance, relative to cross section 250A and maintains a generally uniform beam shape.
- the assembly 204 includes multiple lens elements, where separate lens elements can be adjusted, by one or more actuators included in assembly 204, to adjust divergence along separate cross sectional axes of the beam.
- an assembly can include a first lens element which is adjustable to adjust the beam divergence along the fast axis of the beam and a second lens element which is adjustable to adjust the beam divergence along the slow axis of the beam.
- FIG. 3A-B illustrate adjusting beam divergence of a sequence of light beam pulses scanned by a light beam scanning device over a field of view in a scan pattern, according to some embodiments.
- the light beam scanning device 300 can be included in any of the above embodiments.
- a light beam scanning device scans a light beam over a field of view in which the scene is included, where the image map is generated based on generated point clouds of various objects in the scene, where the point clouds are generated based on detecting reflection points in the field of view and correlating various sets of reflection points to generate point clouds of the various objects based on similar properties of the various sets of reflection points.
- the scanning can include controlling a scanner of the device to direct various pulses towards various regions of the field of view in a scan pattern of pulses through the field of view.
- the scan pattern can include a pattern of pulses which are angularly spaced apart, within the field of view, based at least in part upon one or more of a particular scan rate of the scanner, a particular pulse rate of the emitter, etc.
- the pulses can have one or more various divergences which can be at least partially adjusted by a lens element assembly included in the light beam scanning device.
- one or more of the beam pulse divergence, scan rate, and field of view can be adjusted. Such adjustment can be dynamic, such that it occurs during a given scan of a field of view, is based at least in part upon the scan rate and field of view, is based at least in part upon output generated by a detector included in the light beam scanning device, some combination thereof, etc.
- a given "scan" of a field of view can include executing an individual particular "sweep" of the light beam pulses over the field of view according to a particular scan pattern, such that consecutive "sweeps of the pulsed light beam over the field of view according to one or more scan patterns comprise consecutive individual scans of the field of view.
- beam divergence is adjusted, based at least in part upon the field of view, scan rate, etc. to adjust the likelihood of detecting objects in the field of view, adjust the resolution of the objects in the point clouds of the objects, etc.
- Such adjustment can be implemented by one or more lens element assemblies included in the device. Such adjustment can occur over one or more scans of the field of view, where one or more of field of view, scan rate, and beam divergence can be dynamically adjusted to control resolution of generated point clouds of objects detected in a field of view based on detected reflection points.
- device 300 initiates a scan of a field of view 301 by "sweeping" a pulsed light beam over a portion of the field 301 in a particular pattern 306 of individual pulses 302A of the light beam.
- the illustrated pulses 302A in FIG. 3A illustrate the beam spots, and relative beam spot size, of the light beam scanning the field of view 301 from a perspective of one or more portions of the device 300.
- the pattern 306A is at least partially based on the scan rate of the scanner in the device 300, which can adjust the direction of each pulse 302A within the field 301 and the angular spacing 304A between consecutive pulses 302A.
- the pulsed beam scanned through the field 301 in FIG.
- the 3A has a relatively narrow beam divergence, such that the beam spot of each pulse 302A is relatively small in beam spot size. While small beam spot size of the scanned beam can result in relatively smaller reflection points, which can enable resolution of finer details of an object that larger beam cross sections may be hindered in resolving, the smaller cross sectional area of pulses 302A and the spacing 304A between the pulses 302A can result in at least some of the detail in a field of view being missed by the scan.
- two objects 308, 309 are located within the field of view 301, but none of the beam pulses 302A reflect off of either of the objects 308, 309 when the scan 306A is executed as shown, based at least in part upon the small area of each pulse 302A and the spacing between the pulses 304A.
- reducing the spacing 304A between pulses 302A requires that additional pulses be scanned over the field 301 to scan the field. Scanning such additional pulses results in a given scan requiring a greater time period to execute.
- the time period in which an individual scan can be executed is limited to a maximum time period.
- device 300 may be required to space 304A the pulses 302A apart in the scan of the field 301, such that there are gap spaces between the spaced pulses 302A in which an object may be missed by the pulses 302A, thereby preventing detection of the object by device 300.
- the beam divergence can be adjusted to increase the beam spot size of the beam pulses 302B such that likelihood of detection of the presence of objects 308, 309 in the field of view 301 can be increased when the beam is scanned over the field 301 at the adjusted divergence in scan pattern 306B, relative to the pattern 306A in FIG. 3A.
- the spacing 304B between the individual pulses 302B may be similar to that of the spacing 304A in pattern 306A
- the greater divergence of the beam results in the pulses 302B individually and collectively covering a greater portion of the field of view 301 in a given scan, relative to the pulses of the scan in FIG. 3A.
- pulses 302B may overlap across common regions of the field of view.
- the probability that an object in the field 301 will be completely missed by the scan pattern 306B is reduced, relative to a similar scan pattern 306A with similar scan rate and narrower divergence of the beam.
- the illustrated pulses 302B in FIG. 3B illustrate the beam spots, and relative beam spot size, of the light beam scanning the field of view 301 from a perspective of one or more portions of the device 300.
- the scan pattern 306B results in at least two reflection points being detected for each of objects 308, 309. While the detection points detected based on the scan in FIG. 3B may not result in a high-resolution point cloud which resolves the full detail of the objects 308, 309, based at least in part upon the relatively large size of the beam spot of the scanned beam resulting in relatively large reflection points which can at least partially obscure various details of the objects, the presence of the objects in the field 301 can be detected based on the detected reflection points on each of the objects.
- the field of view 301 can be narrowed to encompass a limited region of field 301 which also encompasses one or more of objects 308, 309 and a subsequent scan can be executed, with a lower scan rate and narrower beam divergence, and thus smaller resulting beam spot size, such that a higher resolution point cloud can be generated for one or more of the objects which provides better resolution of the object details relative to scan 306B.
- Such adjustment of scan rate, field of view, beam divergence, beam spot size, etc. can be implemented during a given "scan" of the field of view according to one or more patterns.
- scans 306 A, 306B are executed by device 300 over field 301 consecutively as scans having alternative beam divergence, so that a wide-divergence scan 306B over a particular region of the field 301 is followed by narrow-divergence scan 306A.
- Such an alternation of divergence, and thus beam spot size, between separate scans can enable detection of the presence of objects in the field 301 via both wide-divergence scans which are more likely to reach an object based at least in part upon the relatively larger beam spot size of the scanned beam and narrow-divergence scans which are more likely to result in detection of a reflection point from a low-reflectivity surface based at least in part upon the relatively smaller and thus higher intensity beam spot size of the scanned beam.
- a light beam scanning device 300 can be limited by the amount of time available in which to execute a scan of a field of view 301; as a result, while scanning a field 301 with pulses having the minimum possible divergence and minimum possible angular difference between pulses may result in maximum resolution, scan times may restrict the ability of device 300 to execute such a scan over an entire selected field 301 of view at such resolution may be complicated. As a result, adjusting the beam divergence can enable initial detection of various objects in a wider field of view at low resolution and dynamic adjustment of one or more of the beam divergence, scan rate, field of view, etc. to generate higher-resolution mapping of the various objects initially detected within the wider field of view.
- such adjustment of beam divergence can result in optimizing processing resources, as the number of scans and processing capacity required to generate high-resolution image maps of various objects in a scene can be reduced as the objects can be quickly identified in a wide-divergence scan and then the objects can be mapped via a narrow- divergence scan of the limited regions of the field of view in which the objects are located.
- device 300 scans a pulsed light beam over a given portion of a field of view based on input data received from one or more other elements of the device.
- the device 300 can include a camera device which can generate one or more images of the scene included in field 301, including an image of objects 308, 309.
- device 300 includes one or more computer systems which can process the images captured by the camera device to identify objects 308, 309 in the image and, based on such identification, device 300 can scan limited regions of field 301 in which objects 308, 309 are located to generate point clouds of the object 308, 309. Such point clouds can be used at device 300 to generate an image of the objects 308, 309, modify the image captured by the camera device, etc.
- the device 300 can include a camera device which can generate one or more images of the scene included in field 301, including an image of objects 308, 309.
- device 300 includes one or more computer systems which can process the images captured by the camera device to identify objects 308, 309 in the image and, based on such identification, device 300 can scan limited regions of
- device 300 includes a user interface and can scan a light beam over a region of a field of view based on user interaction with an image presented to the user via the user interface. For example, upon executing the scan pattern 306B illustrated in FIG. 3B, device 300 can correlate the detected reflection points into low-resolution point clouds of objects 308, 309 and display an image of such objects on the user interface of device 300 based on the point clouds. The device can scan a limited region of the field
- FIG. 4 illustrates dynamically adjusting beam divergence, and thus beam spot size, to generate high-resolution image maps of various objects within the field of view of a light beam scanning device, according to some embodiments.
- Such dynamic adjusting shown in FIG. 4 can be implemented via any of the above embodiments of a light beam scanning device and can be managed by one or more computer systems associated with the light beaming device.
- the dynamic adjustment process 400 illustrated in FIG. 4 includes implanting one or more initial scans of a field of view 401.
- the field of view 401 can include the maximum available field of view, or "scan range,” of the light beam scanning device executing the scan.
- the field of view can be scanned via one or more various individual scans of a light beam over the field where the individual scans are of the light beam at difference divergences.
- Such varying beam divergences can be executed via a lens element assembly included in the light beam scanning device.
- the various scans executed at various beam divergences can facilitate detection of objects within the field of view via optimizing various different beam properties. For example, a scan of a wide-divergence beam over the field of view can increase the probability that the beam will reflect off of a surface of an object in the field, thereby resulting in detection of the object via detecting the reflection point, based on an increased beam cross sectional area ("beam spot") due to increased beam divergence.
- beam spot beam cross sectional area
- a scan of a narrow-divergence beam of the field of view can increase the probability that the beam will reflect off of low-reflectivity surfaces, from which the wide-divergence beam may not reflect off of with sufficient intensity to be detected at a detector of the light beam scanning device, as the intensity of the reflection point can be increased due to the smaller beam cross sectional area.
- a wide-divergence scan 406A of the field 401 can include scanning a sequence of beam pulses 404A over a portion of the field in a particular scan pattern. As shown, the wide-divergence scan 406A can result in at least some of the beam pulses at least partially overlapping with one or more objects 403, 405 located in the scene that is within the field of view 401.
- a narrow-divergence scan 406B of the field 401 can include scanning a sequence of beam pulses 404B over a portion of the field in a particular scan pattern.
- the wide- divergence scan 406A pattern and the narrow-divergence scan 406B pattern can be similar, such that both scans 406 A-B pass over the same portions of the field of view 401, thereby enabling detection of low-reflectivity surfaces, via scan 406B, which may not be detected via scan 406A.
- one or more of the scans 406A-B shown in 410, 420 are omitted from the process 400.
- scan pattern 406B can be omitted, such that a single wide-divergence scan shown in 410 is executed over the field 401.
- the presence of objects 403, 405 in the field of view 401 is determined based on detecting reflection points which result from at least a portion of one or more beam pulses, scanned over the field in one or more of scans 406A-B, reflecting off of the objects and being received at a detector associated with the light beam scanning device executing the scans.
- reflection points 433 are detected which indicate the presence of object 403 within field 401
- reflection points 435 are detected which indicate the presence of object 405 within field 401. Both reflection points 433 and 435 result from the wide-divergence scan 406A shown in 410.
- the narrow-divergence scan 406B may result in at least partially failing to detect the presence of one or more objects within the field, due to the relatively smaller beam cross sectional area and angular spacing between separate beam pulses 404B.
- the scan 406A at 410 results in detection of the presence of objects 403, 405 in the field 401
- the detailed shape, structure, etc. of the objects 403, 405 may not be fully resolved from the reflection points 433, 435.
- a point cloud of object 403, generated from correlation of reflection points 433, may not resolve the structure of object 403 as a five-pointed star.
- fields 432, 434 are established as fields 432, 434.
- Each separate field 432, 434 can be sized based on properties of the reflection points 433, 435, which can be correlated together to establish a "coarse" point cloud of each object 403, 405.
- the fields 432, 434 can be sized based on an estimated size of the object within the field 401, which can be determined based on determining which beam pulses 404A reflected off of objects 403, 405, resulting in reflection points 433, 435, and which pulses did not reflect off of any nearby points, as shown in 430.
- the field 432, 434 can be sized to correspond to an estimation of the size of the objects within the field 401.
- the size and shape of the objects within 401 may be determined from the captured image, such that the fields 432, 434 can be determined based on the determined size and location of the objects within the field 401 based on the captured image.
- the fields 432, 434 can include limited regions of the field 401.
- the light beam device executes scans of the fields 432, 434 with narrow- divergence beam pulses.
- the scans can include scans of the fields 432, 434 to the exclusion of the remainder of the field 401 beyond fields 432, 434.
- the scans 443, 445 can include a scan pattern of the respective fields 432, 434 which is adjusted to correspond to the size of the respective fields 432, 434.
- the angular spacing ("scan rate") between separate beam pulses 444, 446 in the scans can be adjusted to cause the scans 443, 445 to scan the respective regions 432, 434 with narrow-divergence beam pulses at a reduced scan rate.
- the narrow beam divergence which can result in smaller cross sectional beam area
- the low scan rate which can result in an increase in the number of beam pulses in a given area
- the number and concentration of reflection points on the objects 403, 405 within the fields 432, 434 can be increased, relative to the scans at 410, 420.
- point clouds of the objects generated via correlation of reflection points detected as a result of scans 443, 445 can have an increased level of resolution of the detail of the objects 403, 405, relative to that of point clouds of said objects resulting from the detected reflections points 433, 435 resulting from scan 406A.
- reflection points 453, 455 resulting from the scans 443, 445 are detected.
- the detailed shapes and structures of the objects 403, 405 are more highly resolved by reflection points 453, 455, relative to the reflection points 433, 435 resulting from the scan 406A.
- the points 453 can be correlated to generate a point cloud of the object 403, and the points 455 can be correlated to generate a point cloud of the object 405, which can be used as part of generating one or more of an image of the scene within field 401, a 3D map of the scene, tracking the position of one or more of the objects 403, 405 through the scene, etc.
- object 403 may be identified as a particular object ("five-pointed star") based on the correlation of the point objects 453, and the position of the object 403 may be tracked based on such identification.
- Such tracking can be tracked as part of image focus based on the position of object 403, processing the motion of object 403 within the field 401 to determine whether an input command is received, etc.
- such tracking is based at least in part upon a user interaction with the light beam scanning device executing process 400, including a command which specifies a particular object and commands tracking of the object (e.g., "track the star").
- FIG. 5 illustrates a controller device which can be included in a light beam scanning device, according to some embodiments.
- the controller device can be included in any of the above embodiments of a light beam scanning device and can be implemented, at least in part, by one or more computer systems, as discussed below.
- Controller device 500 includes multiple various modules, described herein, which can be implemented by one or more instances of computer systems.
- Device 500 includes an emitter control module 502 which controls emission of a light beam by an emitter device included in the light beam scanning device. Such control can include selecting generating an emission control signal which is transmitted to one or more of the emitter device, a power source electrically coupled to the emitter device, etc. which causes the emitter device to emit the light beam.
- the emission control module can, in some embodiments, selectively control a sequence in which the emitter device emits a sequence of beam pulses. Such control can include controlling the pulse rate 501.
- module 502 can record the time 503 at which individual pulses are emitted by the emitter device.
- Device 500 includes a scanner control module 504 which controls a scanner device included in the light beam scanning device, such that the module 504 controls scanning of a light beam, emitted by the emitter device, over one or more regions of the scan range of the scanner device.
- Scan control module 504 can include a scan rate module 506 which determines the scan rate associated with the scanner device during one or more various scans through the scan range, a beam direction module 508 which determines a direction of the light beam as directed by the scanner device at one or more points in time, and a field of view module 510 which determines a field of view of the scanner, which determines the region of the scan range over which the scanner device is controlled to "scan" the light beam.
- Module 510 determines a pattern in which the scanner device is controlled to sweep the light beam during a given period of time. As shown in FIG. 3-4, such a pattern can include a sinusoidal pattern.
- Module 508 determines a separate adjustment of the scanner device corresponding with each separate beam direction through the field of view, such that the module 508 determines the adjustment to the scanner device, by one or more actuator mechanisms associated with the scanner, needed to direct the light beam in a given direction. Where the scanner device includes a mirror which can be adjusted in orientation, such determination can include determining an orientation of the mirror device which corresponds with the mirror device directing the light beam in a particular direction according to a determined scan pattern.
- Module 506 determines a particular rate at which the scanner device changes the direction in which the light beam is directed, an angular spacing between separate directions of separate light beam pulses, etc. For example, where the emitted light beam is a sequence of pulses, module 506 determines an orientation change rate which corresponds with the pulse rate and a determined angular spacing between separate desired directions of separate sets of beam pulses according to the determined scan pattern. In some embodiments, module 504 controls one or more elements of scanning a light beam over a field of view by the scanner, including controlling the adjustments to the scanner by one or more actuators during a scan, at one or more determined scan rates, to scan the light beam over a determined field of view in one or more various scan patterns.
- Device 500 includes a lens element control module 512 which, in some embodiments, controls a lens element assembly included in the light beam scanning device to control beam divergence of the light beam along one or more cross sectional axes of the beam.
- control can include adjusting one or more lens elements included in the lens element assembly, based at least in part upon generating one or more lens element adjustment command signals which can be transmitted to one or more actuators associated with the one or more lens elements to cause the actuators to adjustably position the one or more lens elements.
- Module 512 can include a beam divergence module 514 which can determine a particular divergence, along one or more cross sectional axes, of the light beam and a lens element positioning module 516 which can determine a magnitude of adjustment of the position of one or more lens elements within the lens element assembly.
- Beam divergence can be determined separately for separate cross sectional axes of the light beam. For example, a first divergence can be determined for a first axis of the beam and a second divergence can be determined for another separate axis of the beam, which can be orthogonal to the first axis.
- Module 516 can determine adjustments to the position of one or more lens elements, based on the determined beam divergences.
- module 516 can determine separate and independent adjustments to separate lens elements in the lens element assembly to independently adjust beam divergence along separate cross sectional axes of the beam. For example, where module 514 determines a common divergence for all cross sectional axes of the beam, module 516 can determine a first adjustment to a first lens element in the lens element assembly, by a first actuator, which adjusts the beam divergence of one cross sectional axis to the common divergence and can determine a second adjustment to a separate lens element in the lens element assembly, by a second actuator, which adjusts the beam divergence of another separate cross sectional axis to the common divergence.
- module 514 determines a divergence of one or more axes of the beam based on one or more various inputs, including a desired cross sectional area of the beam at a certain depth from the scanner, a desired cross sectional shape of the beam, a determined field of view of the scanner, a determined scan rate of the scanner, some combination thereof, etc.
- Module 512 controls one or more actuators in the lens element assembly based on the lens element positions determined at module 516.
- module 512 adjusts beam divergence of the light beam, such that module 512 controls the beam spot size of the light beam, based at least in part upon controlling the beam spot size to match a selected beam spot size, where the selected beam spot size is selected from a set of predetermined beam spot sizes. In some embodiments, module 512 controls the beam spot size of the light beam based at least in part upon one or more received beam spot size commands which specify a particular beam spot size.
- a received beam spot size command can include one or more of a user command generated as a result of an end-user interaction with a light beam scanning device in which controller device 500 is included, a computer command generated by one or more computer systems based on one or more program instructions stored in one or more memory devices of the one or more computer systems, some combination thereof, etc.
- Device 500 includes a detector control module 518 which receives and processes data received from a detector included in the light beam scanning device.
- the detector can detect a light beam reflected off of a surface within the field of view in which the light beam is directed by the scanner device.
- the detector device can include one or more sensor elements which detect the reflected light beam.
- Module 518 can include a point detection module 520 which receives an indication that a reflected light beam is detected at one or more sensor elements of the detector. Based on the detection, module 520 can determine the presence of a reflection point within the field of view in which the emitted light beam is directed.
- module 520 can determine, based on data received from the detector in association with the indication of detection of a reflected light beam, a time at which the reflected light beam is detected at the detector.
- Module 518 can include a flight time module 522 which can determine the time of flight of a light beam to and from the reflection point within the field of view. The flight time can be determined based at least in part upon the time (also referred to as "timestamp") at which a reflected light beam pulse was detected at the detector, a time (also referred to as "timestamp”) at which a light beam pulse was emitted from the emitter device, a pulse rate of the emitter device, some combination hereof, or the like.
- module 522 can determine at least a depth of the detected reflection point within the field of view based at least in part upon the time of flight of the light beam to and from the reflection point (i.e., between one or more portions of the light beam scanning device, including the scanner, and the reflection point) and an estimated speed of light within the medium in the field of view. For example, based at least in part upon the determined time of flight of a light beam pulse to and from the reflection point, and an estimate of the speed of light in the medium through which the light beam pulse travels, the distance traveled by the light beam pulse to the reflection point from one or more portions of the device, including the scanner, can be estimated.
- Module 518 can include an output generator module 523 which generates an output based on the detection of a reflected light beam at the detector device. Detection of a reflected light beam can comprise detection of a reflection point within the field of view of the light beam scanning device.
- the output can include one or more of an indication of a reflection point within the field of view, a determined flight time of a light beam to and from the reflection point, an intensity of the light reflected from the reflection point, a determined depth of the reflection point within the field of view, etc.
- module 518 can determine a position of the detected reflection point within the field of view, relative to one or more elements, portions, etc.
- An indication of the position of the reflection point which can include a depth, azimuth, and elevation of the reflection point within the field of view, and intensity of the reflection point, some combination thereof, etc. can be included in the generated output as part of a set of properties associated with the reflection point.
- Device 500 includes a processing module 524 which receives and processes data from various one of modules 502, 504, 512, 518 and generates image maps of one or more objects, scenes, etc. within a field of view of the light beam scanning device based at least in part upon the data.
- Module 524 includes a point cloud generator module 534 which can receive and process one or more sets of data associated with various reflection points detected at a detector device of the image beam scanning device.
- Each set of data which can be generated at module 534 based on output received from one or more of modules 502, 504, 518, can include data indicating a depth, azimuth, elevation, intensity, some combination thereof, etc. of a detected reflection point within the field of view, relative to one or more portions of the image beam scanning device, including the scanner device.
- a given set of data includes information identifying the set as being associated with a particular scan of the field of view.
- module 534 correlates one or more sets of point data into a set of reflection points which comprise a "point cloud" of an object located within the field of view. Such correlation can include comparing various property data of the various sets of data associated with the various separate detected reflection points and correlating two or more points into a point cloud based at least in part upon determining a similarity between one or more properties of the two or more points. For example, two points determined to have one or more of depth, azimuth, and elevation which are similar within a predetermined margin (e.g., difference in depth is less than lmm, difference in azimuth is less than 0.01 degrees, etc.) may be correlated into a common point cloud.
- a predetermined margin e.g., difference in depth is less than lmm, difference in azimuth is less than 0.01 degrees, etc.
- Module 524 can include an image map generator module 536 which can implement the correlation of various sets of data associated with separate detected reflection points to generate point clouds of various objects.
- Module 536 can, based on the various generated point clouds of objects located within a field of view, generate one or more image maps of a scene, within the field of view, which includes the one or more objects.
- Such a generated image map can include an image of one or more of the objects included in the scene, where the image can be two-dimensional.
- the image map can include a 3D map of one or more objects within the scene and can include a 3D map of some or all of the entire scene.
- module 536 analyzes generated point clouds and identifies a point cloud of an object as being associated with a particular known object (e.g., a fork, a human hand, a human hand making a particular gesture, etc.) and, based on the identification, generates an image map of the particular object.
- Module 524 includes a scan control module 534 which can control one or more of the emitter, scanner, lens element assembly, detector, etc. of the light beam scanning device, via controlling some or all of modules 502, 504, 512, 518. Module 534 can control the various modules to cause the light beam scanning device to execute particular scans.
- module 534 can determine that the resolution of the point cloud does not meet a threshold minimum and can subsequently control modules 502, 504, 512 to execute one or more additional scans which result in higher-resolution point clouds of the object.
- control can include controlling module 504 to narrow the field of view around the detected object and scan at a lower rate through the narrowed field, controlling module 512 to narrow the divergence of the beam scanned through the narrowed field, some combination thereof, etc.
- Module 524 includes a tracking control module 538 which, in some embodiments, responds to identification of a particular object within the field of view by generating commands to one or more of modules 502, 504, 516 to control the light beam scanning device to scan the regions of the field of view in which the identified objects are located, such that the objects are tracked within the field of view over time.
- module 524 controls one or more of modules 502, 504, 512 based at least in part upon output data received from one or more of the modules included in module 500, including, without limitation, output generated at module 518.
- module 534 determines, based on output data generated by module 518 as a result of a scan of a maximum field of view of the light beam scanning device, that one or more reflection points are detected within a particular region of the field of view
- the module 534 can command modules 502, 504, and 512 to narrow the field of view around the detected reflection points, narrow the beam divergence such that higher-resolution scans of the narrowed field of view are implemented, and scan the narrow field of view according to an adjusted scan rate and the adjusted beam divergence.
- module 534 can respond to initial, low-resolution detection of one or more objects within a field of view by commanding the modules 502, 504, 512 to control various elements of the light beam scanning device such that a higher resolution scan of the one or more objects is implemented.
- Device 500 includes an interface control module 540.
- Module 540 can enable user interaction with one or more modules of device 500.
- Module 540 includes a display control module 542 which can manage displays of one or more image maps, generated at module 536, on one or more display user interfaces associated with the light beam scanning device.
- module 542 generates interactive displays, where a user can interact with one or more portions of a displayed image map, via a user interface, to provide input commands to device 500.
- Module 540 includes a user command input module 544 which can register the receipt of one or more particular user commands, based at least in part upon a user interaction with a user interface.
- module 544 can receive a user command to implement a high-resolution scan of a limited region of the field of view in which the object is located based on a user interaction with the portion of the image map, of the scene, in which the object is located.
- the module 544 can register receipt of certain user commands based on user interaction with various user interfaces, including audio commands received via an audio interface, commands received via a keyboard interface, etc.
- module 540 can forward the received user commands to module 524, where module 524 can control various elements of the light beam scanning device based at least in part upon the user commands.
- FIG. 6 illustrates configuring a light beam scanning device to scan a light beam having a dynamically-adjustable divergence within a scan range of the device, according to some embodiments.
- the configuring can be implemented with regard to any or all of the embodiments described above.
- Configuring the light beam scanning device can include modifying at least a portion of a light beam scanning device, assembly of a light beam scanning device, etc.
- the light beam scanning device can include a light detecting and ranging (LIDAR) device.
- LIDAR light detecting and ranging
- a light beam emitter also referred to herein as an emitter device, is installed in a light beam scanning device. Such installation can include coupling the emitter device to a structural frame of the light beam scanning device, electrically coupling the emitter device to an electrical power source, etc.
- the light beam emitter can include a laser emitter, including a laser diode, which can emit a laser light beam.
- the light beam emitted by the emitter device can include one or more of a continuously-emitted light beam, a sequence of light beam pulses, where the sequence of pulses can be determined, some combination thereof, etc.
- a scanner device is installed in the light beam scanning device. Such installation can include coupling the scanner device to a structural frame of the light beam scanning device, electrically coupling the scanner device to an electrical power source, etc.
- the scanner device can be coupled at a location in the light beam scanning device which is at least partially intersected by the beam pathway of the light beam emitted by the emitter device.
- the scanner device can include, in some embodiments, a reflecting device, including a mirror device, which can be adjustably positioned in various orientations, based at least in part upon an action of an actuator device, to direct the light beam into one or more various directions within a field of view external to the light beam scanning device.
- the actuator device can be included in the scanner device.
- the range of directions into which the scanner device can direct the light beam can be referred to as the scan range of the scanner device, the scan range of the light beam scanning device, the maximum field of view of said device, some combination thereof, etc.
- the scanner device can be adjusted through a range of positions to "scan" a light beam through one or more regions of the scan range, including a particular determined field of view within the scan range.
- a light detector device also referred to herein as a detector device, detector, etc.
- a detector device is installed in the light beam scanning device.
- Such installation can include coupling the detector device to a structural frame of the light beam scanning device, electrically coupling the detector device to an electrical power source, etc.
- the detector can include one or more sensor elements which can detect a light beam, and the detector can generate an output signal based on detection of a light beam at one or more of the sensor elements of the detector.
- the detector can detect a reflection of a light beam, directed into the field of view, off of a surface of one or more objects located within the field of view. Based on such detection, the output signal generated by the detector can indicate a reflection point within the field of view.
- the detector determines at least a depth of the reflection point within the field of view based on a time of flight of the light beam from at least a portion of the light beam scanning device to the surface on which the reflection point is located, Such determination can be based at least in part upon a correlation of a time at which a light beam, light beam pulse, etc. is emitted from the emitter device with a time at which a reflected light beam is detected at the detector.
- the output signal indicates an azimuth and elevation of the reflection point within the field of view, based at least in part upon the time of flight of the light beam to the reflection point, and a position of the scanner device concurrently with at least a portion of the time period during which the light beam is directed by the scanner device into a particular direction within the field of view.
- the detector includes a single sensor element.
- a lens element assembly is installed in the light beam scanning device. Such installation can include coupling the lens element assembly to a structural frame of the light beam scanning device, electrically coupling the lens element assembly to an electrical power source, etc.
- the lens element assembly can include one or more lens elements which can be adjustably positioned to adjust a divergence of the light beam emitted by the emitter device.
- the lens elements assembly can be coupled to the light beam scanning device at a location intersected by the beam pathway of the emitted light beam. Such a location can be located between the emitter device and the scanner device, such that the lens element assembly is located "downstream" of the emitter device and "upstream” of the scanner device.
- the lens elements can include a set of multiple lens elements, one or more of which can be adjustably positioned by action of one or more actuator elements.
- the actuator elements can be included in the lens element assembly and can adjustably position one or more individual lens elements in a directional axis which is parallel with the beam pathway through the lens elements assembly. As a result, one or more of the lens elements can be adjustably translated in parallel to the direction of the light beam through the assembly.
- One or more of the lens elements can adjust divergence of the light beam in one or more cross sectional axes through adjustable positioning of the respective lens elements.
- the lens element assembly can include a first lens element which can be adjustably positioned, in parallel with the beam pathway, to adjust a divergence of the beam in a fast axis of the beam and a second lens element which can be adjustably positioned, in parallel with the beam pathway, to adjust a divergence of the beam in a slow axis of the beam.
- the lens element assembly includes one or more lens elements which can be adjustably positioned to adjust divergence of the beam in multiple cross sectional axes, including all cross sectional axes of the beam.
- various lens elements in the lens element assembly can be adjustably positioned independently of each other.
- the lens element assembly includes a light collimator which can at least partially collimate the light beam.
- a light collimator can be located on an "upstream" end of the lens element assembly, such that light received from the emitter device passes through the light collimator prior to passing through one or more of the lens elements which can adjust divergence in one or more cross sectional axes of the light beam.
- a controller device is installed in the light beam scanning device.
- Such installation can include coupling the controller device to a structural frame of the light beam scanning device, electrically coupling the controller device to an electrical power source, etc.
- Such installation can include communicatively coupling the controller device to one or more other elements of the light beam scanning device, including one or more of the emitter device, scanner device, detector device, lens element assembly, some combination thereof, etc.
- the controller device can be included in one or more computer systems and can generate command signals to one or more of the emitter device, lens element assembly, scanner device, and detector to manage scanning of a light beam over at least a portion of the scan range of the light beam scanning device such that a field of view within the scan range can be mapped based on reflection points detected within the field of view.
- FIG. 7 illustrates dynamically adjusting a divergence of a light beam scanned, by a scanner, over a field of view that is within a scan range of the scanner, according to some embodiments.
- Such dynamic adjustment can result in generation of a map of at least a portion of the scene located within the field of view, based at least in part upon a time of flight of the light beam to and from one or more points within the field of view.
- the dynamic adjustment can be implemented with regard to any of the above embodiments of the light beam scanning device by one or more controller devices.
- controller devices can be implemented by one or more computer systems.
- a field of view within a scan range of the light beam scanning device is determined.
- the field of view can include the entirety of the scan range, a limited region of the scan range, etc.
- the field of view can be determined based on a default range of angles through the scan range and can indicate a range of directions through which the scanner device of the light beam scanning device can direct a light beam.
- a divergence of the light beam is determined.
- the divergence also referred to as "beam divergence”
- beam divergence can be determined as an angular value associated with one or more cross sectional axes of the light beam. Separate divergences can be determined in associated with separate cross sectional axes.
- one divergence can be determined for a fast axis of the beam and another divergence can be determined for another axis of the beam, including a slow axis.
- a common divergence is determined for all cross sectional axes of the beam.
- a scan rate of the scanner device is determined.
- the scan rate can be based at least in part upon the determined field of view, the determined beam divergence(s), some combination thereof, etc.
- the scan rate can be associated with an angular step change in direction, in the field of view, between separate directions into which the scanner directs consecutive light beam pulses, thereby being associated with an angular change of the scanner device between directing consecutive beam pulses into the field of view.
- the scan rate indicates a rate at which the scanner device changes the direction of the directed light beam into the field of view.
- the beam divergence is determined at 704 based at least in part upon the field of view and the scan rate.
- a light beam is scanned through the determined field of view, based at least in part upon the determined beam divergence and scan rate.
- Such scanning can include controlling one or more elements of a lens element assembly to adjust beam divergence of one or more cross sectional axes of the beam, controlling the direction into which the scanner device directs the beam, etc.
- Such scanning can include implementing one or more consecutive "scans" of the field of view, wherein at least the scanner device is controllably adjusted within a time period to sweep the light beam through one or more regions of the field of view during the time period.
- Such scanning can follow a particular scan pattern, such that the light beam is swept through the particular scan pattern in the field of view within the time period.
- the scanner device can be controllably adjusted to change orientation between consecutive sets of beam pulses, such that the various beam pulses are directed into different directions within the field of view according to the scan pattern. Directing a light beam, beam pulses, etc. into the field of view according to a scan pattern can result in an even distribution of the light beam through the field of view during the time period.
- One or more of the beam divergence and scan rate can be adjusted over time during a given scan of the determined field of view.
- a scanning of the field of view can include a set of two consecutive and separate "scans" of the field of view according to a particular scan pattern, where the lens element assembly is controllably adjusted between consecutive scans to adjust the beam divergence, so that the separate consecutive scans include separate scans of the light beam over the field of view at separate beam divergences.
- one or more of the beam divergence, scan rate, etc. can be adjusted based on detection of one or more reflection points at a detector device included in the light beam scanning device.
- the output can include an indication that one or more reflection points are detected in the field of view and can include separate sets of information associated with each of the separate reflection points, including one or more of a determined depth, azimuth, and elevation of the point within the field of view. If not, the scanning of the field of view, at 708, can be repeated. If so, at 711, a first set of reflection points are identified and selected.
- a "set" of reflection points can be identified based on a correlation of the points, based on one or more similarities in associated properties of the various points, including one or more of similar depth, azimuth, elevation, intensity, etc. within the field of view.
- Such separate sets of points can be associated with separate objects located within a scene that is within the field of view.
- a point cloud of the selected set of points is generated.
- a next set of points is determined and process 712-714 is repeated relative to the next set. If not, at 720, the generated point clouds are analyzed to determine, at 722, whether the resolution of the point clouds meet a sufficient threshold. Such a threshold can be based at least in part upon the spot size of the reflection points, which can be based on the beam divergence determined at 704, a comparison of one or more point clouds with one or more predetermined objects in one or more predetermined shapes, etc.
- a determination regarding whether a point cloud has sufficient resolution can be based at least in part upon user input, a determination of whether at least a portion of the object is not mapped in the generated point cloud, etc.
- a determination regarding whether a point cloud has sufficient resolution can be based at least in part upon the signal to noise ratio of one or more of the reflection points correlated into the cloud. Such a signal to noise ratio can be determined based at least in part upon the intensity of the reflection point. For example, where the mapped object has a low reflectivity, reflection points detected as a result of a scan with a wide-divergence beam may have low intensity, such that the signal to noise ratio of the reflection points in a point cloud of the object is low.
- a determination can be made that the resolution of the point cloud of the object is less than a threshold.
- an image map of one or more of the various objects is generated, at 724, based on the generated point clouds of the one or more objects.
- the image map can include an image of a scene that is located within the original field of view at 702, where the image includes images of various objects within the scene which are generated based on the generated point clouds of the respective objects.
- the image map is a 3D map of one or more objects located within the original field of view 702, including a 3D map of some or all of a scene located within the original field of view. Based on the generating of the image map, one or more objects located within the image map can be identified and tracked over time.
- a determination is made that a resolution of one or more point clouds fails to meet one or more thresholds one or more of the field of view, scan rate, and beam divergence are determined based on the selected set of reflection points.
- the field of view can be determined as a limited region of the field of view determined at 702, where the limited region encompasses the limited region of the original field of view in which the set of reflection points are located.
- the scan rate can be determined based at least in part upon a rate at which the light beam can be scanned through the new field of view, according to one or more scan patterns, within a given time period.
- the time period can be a set period of time which is equivalent to the time period in which a scan is implemented at 708, and can represent a maximum period of time in which a scan can be implemented.
- the new scan rate can be a minimum scan rate during which the new field of view can be scanned within the given time period, according to one or more scan patterns.
- the beam divergence can be determined based at least in part upon the field of view, scan rate, etc. In some embodiments, the beam divergence is determined based at least in part upon a determined depth of the selected set of reflection points within the field of view.
- the beam divergence is determined such that the cross sectional area of the beam is adjusted according to a relationship between beam cross sectional area and one or more of the field of view size, scan rate, etc. For example, the beam divergence can be decreased according to decreases in the field of view, scan rate, etc., such that overlap between consecutive beam pulses directed into the new field of view is minimized. In some embodiments, beam divergence is adjusted based on a determination that the resolution of a point cloud of an object is less than a threshold due to a low signal to noise ratio of the reflection points in the cloud.
- Such adjustment of beam divergence can include narrowing the beam divergence, so that reflection points on the object can have a greater intensity, and thus higher signal to noise ratio, due to a smaller spot size of the beam reflecting off of the object.
- one or more of the new divergence, field of view, and scan rate is the same as the previous divergence, field of view, scan rate, some combination thereof, etc.
- a particular known object e.g., a human face
- a new field of view, divergence, and scan rate can be determined based on the location of the detected object within the field of view.
- An apparatus comprising:
- a light beam scanning device configured to scan a light beam, over one or more fields of view at one or more scan rates and generate an image map of at least a portion of a scene within the one or more fields of view, based at least in part upon a time of flight of the light beam to and from one or more points within the scene, wherein the device comprises:
- controller device configured to control at least one portion of the light beam scanning device to dynamically adjust a beam spot size of the light beam as the light beam is scanned over at least a portion of at least one field of view.
- the light beam scanning device comprises a plurality of lens elements located within a pathway of the light beam
- the controller device is configured to translate of at least one lens element, in a direction parallel to a direction of the light beam, to a particular position associated with a particular beam spot size of the light beam.
- the controller device is configured to dynamically adjust a beam spot diameter of the light beam along at least one axis of the beam spot, relative to a diameter of the beam spot along at least one other axis of the beam spot.
- the controller device is configured to adjust the beam spot size of the light beam between separate scans of the light beam over at least a portion of a selected field of view, such that the beam spot size of the light beam is different between at least two consecutive scans.
- the controller device is configured to adjust the beam spot size of the light beam during a scan over at least a portion of the selected field of view.
- the controller device is configured to:
- the second field of view comprises a limited region of the first field of view in which the at least one point is located; and the controller device is configured to identify the second field of view, and subsequently scan the light beam over a second field of view, based at least in part upon identification of the limited region in which the at least one point is located.
- the light beam scanning device comprises a detector which is configured to receive the light reflected from at least a point within at least one field of view;
- the controller device is configured to determine at least a depth, azimuth, and elevation of the at least one point located within the scan range, relative to at least a portion of the light beam scanning device, based at least in part upon the time of flight of the light beam to and from the at least one point, and an orientation of a scanner which scans the light beam over at least one field of view within the scan range.
- the controller device is configured to dynamically adjust a beam spot size of the light beam based at least in part upon at least one of:
- a method comprising:
- dynamically adjusting the beam spot size of the light beam comprises adjusting a diameter of at least one axis of the beam spot, relative to a diameter of at least one other axis of the beam spot.
- dynamically adjusting the beam spot size of the light beam comprises:
- a method comprising:
- a light beam scanning device to scan a light beam having a dynamically-adjustable divergence, within a scan range, over a scene that is within a field of view of the scan range and generate a map of at least a portion of the scene, based at least in part upon a time of flight of the light beam to and from one or more points within the scene, wherein the configuring comprises:
- the lens element assembly comprises a plurality of lens elements, wherein at least one of the lens elements is configured to be adjusted along a directional axis which is parallel to a pathway of the light beam and relative to at least one other of the lens elements to adjust the divergence of the light beam.
- the detector is configured to receive the light reflected from at least a point within the field of view and generate an output indicating at least the time of flight of the light beam to and from the point, such that the light beam device is configured to: determine at least a depth, azimuth, and elevation of the one or more points within the, relative to at least a portion of the light beam scanning device based at least in part upon the output generated by the detector and an orientation of the scanner; and
- FIG. 8 illustrates an example computer system 800 that may be configured to include or execute any or all of the embodiments described above.
- computer system 800 may be any of various types of devices, including, but not limited to, a personal computer system, desktop computer, laptop, notebook, tablet, slate, pad, or netbook computer, cell phone, smartphone, PDA, portable media device, mainframe computer system, handheld computer, workstation, network computer, a camera or video camera, a set top box, a mobile device, a consumer device, video game console, handheld video game device, application server, storage device, a television, a video recording device, a peripheral device such as a switch, modem, router, or in general any type of computing or electronic device.
- Various embodiments of a controller device may be executed in one or more computer systems 800, which may interact with various other devices.
- computer system 800 includes one or more processors 810 coupled to a system memory 820 via an input/output (I/O) interface 830.
- Computer system 800 further includes a network interface 840 coupled to I/O interface 830, and one or more input/output devices 850, such as cursor control device 860, keyboard 870, and display(s) 880.
- embodiments may be implemented using a single instance of computer system 800, while in other embodiments multiple such systems, or multiple nodes making up computer system 800, may be configured to host different portions or instances of embodiments.
- some elements may be implemented via one or more nodes of computer system 800 that are distinct from those nodes implementing other elements.
- computer system 800 may be a uniprocessor system including one processor 810, or a multiprocessor system including several processors 810 (e.g., two, four, eight, or another suitable number).
- processors 810 may be any suitable processor capable of executing instructions.
- processors 810 may be general- purpose or embedded processors implementing any of a variety of instruction set architectures (ISAs), such as the x86, PowerPC, SPARC, or MIPS ISAs, or any other suitable ISA.
- ISAs instruction set architectures
- each of processors 810 may commonly, but not necessarily, implement the same ISA.
- System memory 820 may be configured to store camera control program instructions 822 and/or camera control data accessible by processor 810.
- system memory 820 may be implemented using any suitable memory technology, such as static random access memory (SRAM), synchronous dynamic RAM (SDRAM), nonvolatile/Flash-type memory, or any other type of memory.
- program instructions 822 may be configured to implement a beam divergence control incorporating any of the functionality described above.
- control data of memory 820 may include any of the information or data structures described above.
- program instructions and/or data may be received, sent or stored upon different types of computer-accessible media or on similar media separate from system memory 820 or computer system 800. While computer system 800 is described as implementing the functionality of functional blocks of previous Figures, any of the functionality described herein may be implemented via such a computer system.
- I/O interface 830 may be configured to coordinate I/O traffic between processor 810, system memory 820, and any peripheral devices in the device, including network interface 840 or other peripheral interfaces, such as input/output devices 850.
- I/O interface 830 may perform any necessary protocol, timing or other data transformations to convert data signals from one component (e.g., system memory 820) into a format suitable for use by another component (e.g., processor 810).
- I/O interface 830 may include support for devices attached through various types of peripheral buses, such as a variant of the Peripheral Component Interconnect (PCI) bus standard or the Universal Serial Bus (USB) standard, for example.
- PCI Peripheral Component Interconnect
- USB Universal Serial Bus
- I/O interface 830 may be split into two or more separate components, such as a north bridge and a south bridge, for example. Also, in some embodiments some or all of the functionality of I/O interface 830, such as an interface to system memory 820, may be incorporated directly into processor 810.
- Network interface 840 may be configured to allow data to be exchanged between computer system 800 and other devices attached to a network 885 (e.g., carrier or agent devices) or between nodes of computer system 800.
- Network 885 may in various embodiments include one or more networks including but not limited to Local Area Networks (LANs) (e.g., an Ethernet or corporate network), Wide Area Networks (WANs) (e.g., the Internet), wireless data networks, some other electronic data network, or some combination thereof.
- LANs Local Area Networks
- WANs Wide Area Networks
- wireless data networks some other electronic data network, or some combination thereof.
- network interface 840 may support communication via wired or wireless general data networks, such as any suitable type of Ethernet network, for example; via telecommunications/telephony networks such as analog voice networks or digital fiber communications networks; via storage area networks such as Fibre Channel SANs, or via any other suitable type of network and/or protocol.
- general data networks such as any suitable type of Ethernet network, for example; via telecommunications/telephony networks such as analog voice networks or digital fiber communications networks; via storage area networks such as Fibre Channel SANs, or via any other suitable type of network and/or protocol.
- Input/output devices 850 may, in some embodiments, include one or more display terminals, keyboards, keypads, touchpads, scanning devices, voice or optical recognition devices, or any other devices suitable for entering or accessing data by one or more computer systems 800. Multiple input/output devices 850 may be present in computer system 800 or may be distributed on various nodes of computer system 800. In some embodiments, similar input/output devices may be separate from computer system 800 and may interact with one or more nodes of computer system 800 through a wired or wireless connection, such as over network interface 840.
- memory 820 may include program instructions 822, which may be processor-executable to implement any element or action described above.
- the program instructions may implement the methods described above.
- different elements and data may be included. Note that data may include any data or information described above.
- computer system 800 is merely illustrative and is not intended to limit the scope of embodiments.
- the computer system and devices may include any combination of hardware or software that can perform the indicated functions, including computers, network devices, Internet appliances, PDAs, wireless phones, pagers, etc.
- Computer system 800 may also be connected to other devices that are not illustrated, or instead may operate as a stand-alone system.
- the functionality provided by the illustrated components may in some embodiments be combined in fewer components or distributed in additional components.
- the functionality of some of the illustrated components may not be provided and/or other additional functionality may be available.
- instructions stored on a computer-accessible medium separate from computer system 800 may be transmitted to computer system 800 via transmission media or signals such as electrical, electromagnetic, or digital signals, conveyed via a communication medium such as a network and/or a wireless link.
- Various embodiments may further include receiving, sending or storing instructions and/or data implemented in accordance with the foregoing description upon a computer-accessible medium.
- a computer-accessible medium may include a non-transitory, computer-readable storage medium or memory medium such as magnetic or optical media, e.g., disk or DVD/CD-ROM, volatile or non-volatile media such as RAM (e.g. SDRAM, DDR, RDRAM, SRAM, etc.), ROM, etc.
- a computer-accessible medium may include transmission media or signals such as electrical, electromagnetic, or digital signals, conveyed via a communication medium such as network and/or a wireless link.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
Description
Claims
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/628,042 US9921299B2 (en) | 2015-02-20 | 2015-02-20 | Dynamic beam spot size for light beam scanning device |
US14/628,054 US10107914B2 (en) | 2015-02-20 | 2015-02-20 | Actuated optical element for light beam scanning device |
PCT/US2016/018790 WO2016134321A1 (en) | 2015-02-20 | 2016-02-19 | Actuated optical element for light beam scanning device |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3259615A1 true EP3259615A1 (en) | 2017-12-27 |
EP3259615B1 EP3259615B1 (en) | 2019-11-20 |
Family
ID=55447177
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP16707357.6A Active EP3259615B1 (en) | 2015-02-20 | 2016-02-19 | Actuated optical element for light beam scanning device |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP3259615B1 (en) |
CN (1) | CN107257931B (en) |
WO (1) | WO2016134321A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021185608A1 (en) * | 2020-03-17 | 2021-09-23 | Signify Holding B.V. | A tunable laser based light source |
EP4198451A1 (en) * | 2021-12-15 | 2023-06-21 | Hexagon Technology Center GmbH | Surveying device comprising a range imaging sensor and a settable target illuminator to provide an area illumination in different illumination states |
Families Citing this family (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018102190A1 (en) | 2016-11-29 | 2018-06-07 | Blackmore Sensors and Analytics Inc. | Method and system for classification of an object in a point cloud data set |
JP6811862B2 (en) | 2016-11-30 | 2021-01-13 | ブラックモア センサーズ アンド アナリティクス エルエルシー | Adaptive scanning methods and systems with an optical rangefinder |
CN113985427A (en) | 2016-11-30 | 2022-01-28 | 布莱克莫尔传感器和分析有限责任公司 | Method and system for Doppler detection and correction of optical chirp distance detection |
EP3548925B1 (en) * | 2016-11-30 | 2024-05-22 | Aurora Operations, Inc. | Method and system for automatic real-time adaptive scanning with optical ranging systems |
KR101923724B1 (en) * | 2017-01-02 | 2019-02-22 | 전자부품연구원 | Transmitting integrated type optical structure and scanning LiDAR having the same |
US10422880B2 (en) | 2017-02-03 | 2019-09-24 | Blackmore Sensors and Analytics Inc. | Method and system for doppler detection and doppler correction of optical phase-encoded range detection |
US10401495B2 (en) | 2017-07-10 | 2019-09-03 | Blackmore Sensors and Analytics Inc. | Method and system for time separated quadrature detection of doppler effects in optical range measurements |
US11561283B2 (en) | 2017-11-16 | 2023-01-24 | Nec Corporation | Distance measurement apparatus, distance measurement method and program |
US10942244B2 (en) | 2017-12-12 | 2021-03-09 | Waymo Llc | Systems and methods for LIDARs with adjustable resolution and failsafe operation |
EP4246176A3 (en) | 2018-04-23 | 2023-12-13 | Blackmore Sensors & Analytics, LLC | Method and system for controlling autonomous vehicle using coherent range doppler optical sensors |
US11822010B2 (en) | 2019-01-04 | 2023-11-21 | Blackmore Sensors & Analytics, Llc | LIDAR system |
KR20220003600A (en) * | 2019-05-30 | 2022-01-10 | 옵시스 테크 엘티디 | Eye-safe long-distance LIDAR system using actuators |
CN110346780A (en) * | 2019-07-31 | 2019-10-18 | 炬佑智能科技(苏州)有限公司 | Flight time sensing cameras and its local detection accuracy method of adjustment |
US11500070B2 (en) * | 2019-09-04 | 2022-11-15 | Lumentum Operations Llc | Optical device having two scanning components, one configured to compensate for field distortion |
GB2588678A (en) * | 2019-11-01 | 2021-05-05 | Cambridge Mechatronics Ltd | A time-of-flight sensor system |
CN113075689A (en) * | 2020-01-03 | 2021-07-06 | 华为技术有限公司 | TOF depth sensing module and image generation method |
CN113075690B (en) * | 2020-01-03 | 2023-04-28 | 华为技术有限公司 | TOF depth sensing module and image generation method |
CN113156458A (en) * | 2020-01-03 | 2021-07-23 | 华为技术有限公司 | TOF depth sensing module and image generation method |
CN114026410A (en) * | 2020-05-19 | 2022-02-08 | 深圳市大疆创新科技有限公司 | Point cloud coloring method, point cloud coloring system, and computer storage medium |
EP4012454B1 (en) * | 2020-12-10 | 2024-06-26 | Hexagon Technology Center GmbH | Scanning device with point-to point focusing |
CN112415533B (en) * | 2021-01-21 | 2021-04-16 | 杭州蓝芯科技有限公司 | Depth sensing method and device based on chirped pulse and sensor |
US20230069201A1 (en) * | 2021-09-02 | 2023-03-02 | Silc Technologies, Inc. | Use of multiple steering mechanisms in scanning |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH0627904B2 (en) * | 1986-02-06 | 1994-04-13 | 旭光学工業株式会社 | Laser beam scanning optics |
US5220452A (en) * | 1990-08-06 | 1993-06-15 | Texas Instruments Incorporated | Volume display optical system and method |
US6420698B1 (en) * | 1997-04-24 | 2002-07-16 | Cyra Technologies, Inc. | Integrated system for quickly and accurately imaging and modeling three-dimensional objects |
AT412032B (en) * | 2001-12-19 | 2004-08-26 | Riegl Laser Measurement Sys | METHOD FOR RECORDING AN OBJECT SPACE |
US7064810B2 (en) * | 2003-09-15 | 2006-06-20 | Deere & Company | Optical range finder with directed attention |
CN1825162A (en) * | 2005-02-21 | 2006-08-30 | 株式会社理光 | Scanning optical system, optical scanner, and image forming apparatus |
JP4612723B2 (en) * | 2005-10-25 | 2011-01-12 | プリズム インコーポレイテッド | Optical design of a scanning beam display system using a fluorescent screen. |
US8248679B2 (en) * | 2007-08-21 | 2012-08-21 | Prsym, Inc. | Multibeam scanning device |
CN101344593B (en) * | 2008-05-14 | 2010-10-20 | 中国科学院上海光学精密机械研究所 | Sliding bunching synthetic aperture laser imaging radar |
US8213022B1 (en) * | 2009-03-04 | 2012-07-03 | University Of Central Florida Research Foundation, Inc. | Spatially smart optical sensing and scanning |
WO2011127375A1 (en) * | 2010-04-09 | 2011-10-13 | Pochiraju Kishore V | Adaptive mechanism control and scanner positioning for improved three-dimensional laser scanning |
-
2016
- 2016-02-19 WO PCT/US2016/018790 patent/WO2016134321A1/en active Application Filing
- 2016-02-19 CN CN201680010947.8A patent/CN107257931B/en active Active
- 2016-02-19 EP EP16707357.6A patent/EP3259615B1/en active Active
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2021185608A1 (en) * | 2020-03-17 | 2021-09-23 | Signify Holding B.V. | A tunable laser based light source |
JP2023517137A (en) * | 2020-03-17 | 2023-04-21 | シグニファイ ホールディング ビー ヴィ | Tunable laser-based light source |
US11942990B2 (en) | 2020-03-17 | 2024-03-26 | Signify Holding B.V. | Tunable laser based light source |
EP4198451A1 (en) * | 2021-12-15 | 2023-06-21 | Hexagon Technology Center GmbH | Surveying device comprising a range imaging sensor and a settable target illuminator to provide an area illumination in different illumination states |
Also Published As
Publication number | Publication date |
---|---|
EP3259615B1 (en) | 2019-11-20 |
WO2016134321A1 (en) | 2016-08-25 |
CN107257931A (en) | 2017-10-17 |
CN107257931B (en) | 2020-09-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11255972B2 (en) | Actuated optical element for light beam scanning device | |
EP3259615B1 (en) | Actuated optical element for light beam scanning device | |
US9921299B2 (en) | Dynamic beam spot size for light beam scanning device | |
US10996049B2 (en) | Method and system for adjusting light pattern for structured light imaging | |
EP1512989B1 (en) | Method and system for optically tracking a target using a triangulation technique | |
EP3346290B1 (en) | Time-of-flight camera system and method to improve measurement quality of weak field-of-view signal regions | |
US20150253428A1 (en) | Determining positional information for an object in space | |
US20170186182A1 (en) | Method and system for generating light pattern using polygons | |
KR20210152036A (en) | The laser scan system, the laser scan method, and the movement laser scan system and program | |
JP2022511257A (en) | Depth detection using lattice light pattern | |
US20210256740A1 (en) | Method for increasing point cloud sampling density, point cloud processing system, and readable storage medium | |
US11828878B2 (en) | LiDAR system and operating method thereof | |
EP3788402A1 (en) | Time of flight ranging with varying fields of emission | |
US20200137289A1 (en) | Method and system for head mounted display infrared emitter brightness optimization based on image saturation | |
CN108152822B (en) | Laser radar and laser radar control method | |
KR102137313B1 (en) | Method and system for controlling lidar sensor | |
WO2022200269A1 (en) | Illumination device and method for time-of-flight cameras | |
KR20200075707A (en) | Method, server, device and program for control of motion recognition device according to recognition position of gesture | |
US11947404B2 (en) | Electronic device control method and device | |
CN217385838U (en) | Time-of-flight (TOF) camera apparatus | |
WO2023141782A1 (en) | Laser radar and control method for laser radar | |
CN117043639A (en) | Control method, laser radar and terminal equipment | |
US20210080584A1 (en) | Laser beam control in a lidar system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20170829 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: APPLE INC. |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20180906 |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20190604 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602016024634 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1204802 Country of ref document: AT Kind code of ref document: T Effective date: 20191215 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20191120 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200221 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200220 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200220 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200320 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20200412 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1204802 Country of ref document: AT Kind code of ref document: T Effective date: 20191120 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602016024634 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
26N | No opposition filed |
Effective date: 20200821 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20200229 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200219 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200229 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200229 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200229 Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200219 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20200229 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20191120 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230523 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20231228 Year of fee payment: 9 Ref country code: GB Payment date: 20240108 Year of fee payment: 9 |