EP3350620A2 - Light detection and ranging (lidar) system with dual beam steering - Google Patents

Light detection and ranging (lidar) system with dual beam steering

Info

Publication number
EP3350620A2
EP3350620A2 EP16854598.6A EP16854598A EP3350620A2 EP 3350620 A2 EP3350620 A2 EP 3350620A2 EP 16854598 A EP16854598 A EP 16854598A EP 3350620 A2 EP3350620 A2 EP 3350620A2
Authority
EP
European Patent Office
Prior art keywords
scan
laser beams
beam scanner
scan patterns
scanning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP16854598.6A
Other languages
German (de)
French (fr)
Other versions
EP3350620B1 (en
Inventor
Volodimir Slobodyanyuk
Evgeni Petrovich Gousev
Karim Arabi
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Publication of EP3350620A2 publication Critical patent/EP3350620A2/en
Application granted granted Critical
Publication of EP3350620B1 publication Critical patent/EP3350620B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481Constructional features, e.g. arrangements of optical elements
    • G01S7/4817Constructional features, e.g. arrangements of optical elements relating to scanning
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/42Simultaneous measurement of distance and other co-ordinates
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/87Combinations of systems using electromagnetic waves other than radio waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/93Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles

Definitions

  • LIDAR and more particularly, to dual beam steering in LIDAR.
  • LIDARs have been used in various applications for detecting stationary and moving objects.
  • LIDARs are increasingly being implemented in vehicle collision avoidance systems to detect stationary and moving vehicles to avoid traffic collisions.
  • detection of objects is achieved by scanning a laser beam in a predetermined scan pattern.
  • a laser beam in a conventional LIDAR system may be redirected by reflecting the laser beam from a moving or rotating mirror.
  • the moving or rotating mirror may be mechanically controlled, for example, by a micro-electro-mechanical system (MEMS).
  • MEMS micro-electro-mechanical system
  • Such mechanical or MEMS controlled mirrors are capable of scanning the laser beam in predetermined patterns but are typically not capable of foveation, that is, pointing the beam in random directions, or pointing the beam to different spots at different times not based on a predetermined scan pattern.
  • Diffraction-based liquid-crystal-on- silicon (LCOS) beam steering may be capable of foveation, but the switching rates of typical LCOS systems are relatively low.
  • Exemplary embodiments of the disclosure are directed to apparatus and methods for dual or multiple beam steering in light detection and ranging (LIDAR) systems.
  • LIDAR light detection and ranging
  • a LIDAR apparatus comprising: a first beam scanner configured to scan in one or more of a first plurality of scan patterns; and a second beam scanner configured to scan in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns; and a controller coupled to the first beam scanner and the second beam scanner, the controller configured to drive the first beam scanner based on one or more areas of interest in which one or more targets are likely located and to drive the second beam scanner to monitor one or more identified targets in said one or more areas of interest.
  • a LIDAR apparatus comprising: first means for scanning one or more laser beams in one or more of a first plurality of scan patterns; and second means for scanning one or more laser beams in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns; and means for controlling the first means for scanning and the second means for scanning, comprising: means for driving the first beam scanner based on one or more areas of interest in which one or more targets are likely located; and means for driving the second beam scanner to monitor one or more identified targets in said one or more areas of interest.
  • a method of scanning one or more laser beams comprising: scanning one or more laser beams in one or more of a first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located; and scanning one or more laser beams in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns to monitor one or more identified targets in said one or more areas of interest.
  • an apparatus for scanning one or more laser beams comprising: logic configured to scan one or more laser beams in one or more of a first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located; and logic configured to scan one or more laser beams in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns to monitor one or more identified targets in said one or more areas of interest.
  • FIG. 1 is a diagram illustrating an example of a traffic environment in which a light detection and ranging (LIDAR) apparatus may be implemented in a vehicle for collision avoidance.
  • LIDAR light detection and ranging
  • FIG. 2 is a block diagram illustrating an embodiment of a LIDAR apparatus with dual beam steering.
  • FIG. 3 is a flowchart illustrating an embodiment of a method of scanning one or more laser beams by a LIDAR apparatus.
  • FIG. 4 is a block diagram illustrating an embodiment of logic configured to scan one or more laser beams by a LIDAR apparatus.
  • FIG. 1 is a diagram illustrating an example of a traffic environment in which one or more vehicles may be equipped with light detection and ranging (LIDAR) apparatus for collision avoidance.
  • a first vehicle 102 drives on the same road as second, third and fourth vehicles 104, 106 and 108.
  • the second and third vehicles 104 and 106 move in a direction opposite that of the first vehicle 102, whereas the fourth vehicle 108 moves in the same direction as the first vehicle 102.
  • the fourth vehicle 108 may not present an immediate safety concern to the first vehicle 102 because it travels in a different lane and moves in the same direction as the first vehicle 102.
  • the third vehicle 106 moves in the direction facing the first vehicle 102, it travels in a different lane and may not present an immediate safety threat to the first vehicle 102.
  • the second vehicle 104 may present a more immediate safety threat to the first vehicle 102 because it travels in the same lane as the first vehicle 102 and moves in a direction approaching the first vehicle 102.
  • the first vehicle 102 is equipped with a light detection and ranging (LIDAR) apparatus, embodiments of which will be described in further detail below with reference to FIGs. 2-4.
  • LIDAR light detection and ranging
  • the LIDAR apparatus in the first vehicle 102 is able to scan a relatively wide sector indicated by angle a, covering an area 110 that includes the positions of the third and fourth vehicles 106 and 108 in the example illustrated in FIG. 1.
  • the third and fourth vehicles 106 and 108 in the example illustrated in FIG. 1 may not present immediate threats to the safety of the first vehicle 102, they may change directions and swerve into the lane in which the first vehicle 102 is traveling, for example.
  • the LIDAR apparatus in the first vehicle 102 is also capable of tracking or providing fast updates of objects that may present more immediate safety concerns to the first vehicle 102, for example, the second vehicle 104 traveling in the same lane as and in the direction facing the first vehicle 102, in the example illustrated in FIG. 1.
  • the LIDAR apparatus in the first vehicle 102 is capable of fast beam scanning within a sector indicated by angle ⁇ , covering an area 112 smaller than the area 110, to provide fast updates on the distance or velocity of the second vehicle 104 within the area 112.
  • FIG. 2 is a block diagram illustrating an embodiment of a LIDAR apparatus
  • the LIDAR apparatus 202 which may be implemented in the first vehicle 102 for vehicle detection and collision avoidance.
  • the LIDAR apparatus 202 as illustrated in FIG. 2 is not limited to automobile applications as illustrated in FIG. 1.
  • the LIDAR apparatus 202 may be implemented in a tracked vehicle, a train, a watercraft, or an aircraft for collision avoidance.
  • the LIDAR apparatus 202 may also be implemented in a portable device carried by a pedestrian, or installed on a bicycle, a scooter, or a motorcycle, for example.
  • the LIDAR apparatus 202 may be installed at a stationary location to monitor traffic patterns or to provide warnings.
  • the LIDAR apparatus 202 comprises a controller 204, a first beam scanner 206 coupled to the controller 204, and a second beam scanner 208 coupled to the controller 204.
  • the first beam scanner 206 is configured to scan a laser beam in one or more of a first plurality of scan patterns
  • the second beam scanner 208 is configured to scan a laser beam in one or more of a second plurality of scan patterns different from the first plurality of scan patterns for the first beam scanner 206.
  • the controller 204 includes a processor 210, a memory
  • the first beam scanner driver 214 in the controller 204 is coupled to the first beam scanner 206 and directs the laser beam transmitted by the first beam scanner 206 by issue steering commands to the first beam scanner 206.
  • the second beam scanner driver 216 in the controller 204 is coupled to the second beam scanner 208 and directs the laser beam transmitted by the second beam scanner 208 by issuing commands to the second beam scanner 208 to point the laser beam in a given direction at a given time.
  • the LIDAR apparatus in the embodiment shown in FIG. 2 illustrates the first beam scanner driver 214 and the second beam scanner driver 216 as separate blocks from the processor 210 and the memory 212, the beam scanner drivers 214 and 216 may be integral parts of the processor 210 and the memory 212 in another embodiment.
  • the first beam scanner 206 is configured to scan a wider area than the second beam scanner 208.
  • the first beam scanner 206 is configured to scan the area 110 of the sector covered by angle a
  • the second beam scanner is configured to scan the area 112 of the sector covered by angle ⁇ .
  • the first beam scanner 206 may be configured to scan in a predetermined scan pattern covering a wide area.
  • the first beam scanner 206 may be programmed to scan in a line-by-line pattern, or a left-right-left-right pattern, or another pattern which allows the laser beam from the first beam scanner 206 to sweep across the area 110 of the sector covered by angle a.
  • the first beam scanner 206 may include a laser beam reflector which is movable or rotatable to sweep a reflected laser beam across the area 110.
  • the laser beam reflector may be a mechanically controlled reflector, for example, a microelectromechanical system (MEMS) controlled reflector, examples of which are known to persons skilled in the art.
  • MEMS microelectromechanical system
  • other types of scanners that are capable of steering a laser beam to sweep across the area 110 may also be implemented as the first beam scanner 206 in FIG. 2.
  • the pattern of laser beam scanning by the first beam scanner 206 need not be fixed.
  • the first beam scanner driver 214 in the controller 204 may issue steering commands to the first beam driver 206 according to different scan patterns based on various factors.
  • the angle a for the sector to be covered by the first beam scanner 206 may vary based on whether the road on which the vehicle is traveling is a wide highway or a narrow alley, or other factors that may have a bearing on how wide the angle a needs to be.
  • Such factors may be derived from knowledge obtained from other sources, for example, from a navigation system coupled to the LIDAR apparatus 202 as shown in FIG. 2.
  • the first beam scanner 206 covers one or more areas of interest in which one or more targets of interest are likely located. Such areas of interest may be relatively wide in some traffic environments, for example, on multi- lane highways or on roads at or near intersections. In an embodiment, it is not necessary for the first beam scanner 206 to be able to track precisely one or more specific targets in one or more areas of interest covered by the first beam scanner 206.
  • the first beam scanner 206 only needs to obtain target data based on reflections of the laser beam from these targets and conveys the data to the processor 210 in the controller 204, which makes a determination as to which of these targets would be a target of interest.
  • a target of interest identified in one or more areas scanned by the first beam scanner 206 may be a target closest to the vehicle equipped with the LIDAR apparatus, a target which approaching at a high velocity, or a target which presents a great risk of collision.
  • more than one target of interest may be identified by the controller 204 for more precise monitoring or tracking.
  • second beam scanner driver 216 in the controller 204 issues beam directing commands to the second beam scanner 208 to direct the laser beam transmitted by the second beam scanner to spots within the area 112 of the sector covered by angle ⁇ , as shown in FIG. 2.
  • the second beam scanner 208 comprises a beam scanner configured for foveation, that is, for directing the laser beam in random directions to random spots within the area 112, or alternatively, in preprogrammed directions that appear to be random.
  • the second beam scanner 208 comprises a diffraction-based beam scanner, for example, a liquid-crystal-on- silicon (LCOS) based beam scanner.
  • LCOS liquid-crystal-on- silicon
  • the first beam scanner 206 and the second beam scanner 208 which are parts of the LIDAR apparatus 202, may be physically located adjacent to each other.
  • the blocks for the first beam scanner 206 and the second beam scanner 208 are shown as separate blocks in FIG. 2 for illustrating their respective functionalities.
  • FIG. 1 which illustrates an exemplary traffic environment for the first vehicle 102 in which the LIDAR apparatus 202 of FIG. 2 is implemented, the area 112 of the narrower sector covered by angle ⁇ is included within the area 110 of the wider sector covered by angle a.
  • the first beam scanner 206 in FIG. 2 is configured to scan a first laser beam
  • a second beam scanner 208 is configured to scan a second laser beam
  • one or more additional beam scanners may be implemented in the LIDAR apparatus to scan one or more additional areas of interest, for example, areas to the left, right or rear of the first vehicle 102 as shown in FIG. 1.
  • the first beam scanner 206 and the second beam scanner are identical to each other.
  • a single laser source and a beam splitter may be provided in the LIDAR apparatus, and one of the split laser beams may be directed by the first beam scanner 206 for wide area scanning while the other split laser beam may be directed by the second beam scanner 208 for narrow area scanning.
  • the first and second beam scanners 206 and 208 may be configured to direct two laser beams at two different wavelengths.
  • additional information may be obtained by comparing the reflected signals from a given target of interest at different wavelengths, thereby allowing the LIDAR apparatus to perform further analysis of the target of interest.
  • laser beams of different wavelengths may also be directed at other targets or objects in an area of coverage to obtain further knowledge of the targets or objects in the area, to obtain additional information that allows for further analysis of the environment in which the LIDAR apparatus is operating. For example, reflections of laser beams at different wavelengths may yield information on what types of vehicles are in the vicinity of the vehicle equipped with the LIDAR apparatus in a traffic environment.
  • FIG. 3 is a flowchart illustrating an embodiment of a method of scanning one or more laser beams by a LIDAR apparatus.
  • the step of scanning one or more laser beams in one or more of a first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located is shown in block 302.
  • the step of scanning one or more laser beams in one or more of a second plurality of scan patterns different from one or more of the first plurality of scan patterns to monitor one or more identified targets in one or more areas of interest is shown in block 304.
  • the scanning of one or more laser beams in one or more of the first plurality of scan patterns as shown in block 302 of FIG. 3 is performed by the first beam scanner 206 as shown in FIG. 2.
  • the first beam scanner 206 may scan a relatively wide area or sector using a predetermined scan pattern.
  • the scanning of one or more laser beams as shown in block 302 of FIG. 3 may be performed by a laser beam reflector, for example, a mechanically controlled reflector such as a MEMS controlled reflector.
  • the scanning of one or more laser beams in one or more of the second plurality of scan patterns as shown in block 304 of FIG. 3 is performed by the second beam scanner 208 as shown in FIG. 2.
  • the second beam scanner 208 may scan a relatively narrow area or sector compared to the area or sector scanned by the first beam scanner 206.
  • the scanning of one or more laser beams as shown in block 304 of FIG. 3 may be performed by a laser beam scanner configured for foveation, that is, for directing the laser beam in random directions to random spots, or alternatively, in preprogrammed directions that appear to be random.
  • the laser beam scanner that performs the scanning according to block 304 of FIG. 3 comprises a diffraction-based beam scanner, for example, a LCOS based beam scanner.
  • FIG. 4 is a block diagram illustrating an embodiment of an apparatus 400 for scanning one or more laser beams by a LIDAR apparatus.
  • the apparatus 400 includes logic configured to scanning one or more laser beams in one or more of a first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located, as shown in block 402.
  • the apparatus 400 also includes logic configured to scan one or more laser beams in one or more of a second plurality of scan patterns different from one or more of the first plurality of scan patterns to monitor one or more identified targets in one or more areas of interest is shown in block 404.
  • the logic configured to scan one or more laser beams in one or more of the first plurality of scan patterns as shown in block 402 includes logic configured to scan one or more laser beams by a laser beam reflector, for example, a mechanically controlled reflector such as a MEMS controlled reflector.
  • the logic configured to scan one or more laser beams in one or more of the second plurality of scan patterns as shown in block 404 includes logic configured to scan one or more laser beams by a diffraction-based beam scanner, such as a LCOS based beam scanner.
  • the logic configured to scan one or more laser beams in one or more of the first plurality of scan patterns as shown in block 402 and the logic configured to scan one or more laser beams in one or more of the second plurality of scan patterns as shown in block 404 may be implemented in the controller 204 as shown in FIG. 2.
  • the logic blocks 402 and 404 may be implemented in a hard-wired logic circuit in the processor 210, or alternatively, as a combination of hardware and software in the processor 210 and the memory 212.
  • a software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD- ROM, or any other form of storage medium known in the art.
  • An exemplary storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor.
  • an embodiment of the disclosure can include a computer readable media embodying a method for cache way prediction using partial tags. Accordingly, the disclosure is not limited to illustrated examples and any means for performing the functionality described herein are included in embodiments of the disclosure.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Electromagnetism (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Optical Radar Systems And Details Thereof (AREA)

Abstract

A light detection and ranging (LIDAR) apparatus includes dual beam scanners with dual beam steering. A first beam scanner in the LIDAR apparatus scans a wider area in one or more of a first plurality of scan patterns, and a second beam scanner in the LIDAR apparatus scans a narrower area in one or more of a second plurality of scan patterns different from the first plurality of scan patterns.

Description

LIGHT DETECTION AND RANGING (LIDAR) SYSTEM WITH
DUAL BEAM STEERING
Field of Disclosure
[0001] Various embodiments described herein relate to light detection and ranging
(LIDAR), and more particularly, to dual beam steering in LIDAR.
Background
[0002] LIDARs have been used in various applications for detecting stationary and moving objects. For example, LIDARs are increasingly being implemented in vehicle collision avoidance systems to detect stationary and moving vehicles to avoid traffic collisions. In a conventional LIDAR system, detection of objects is achieved by scanning a laser beam in a predetermined scan pattern. For example, a laser beam in a conventional LIDAR system may be redirected by reflecting the laser beam from a moving or rotating mirror. The moving or rotating mirror may be mechanically controlled, for example, by a micro-electro-mechanical system (MEMS). Such mechanical or MEMS controlled mirrors are capable of scanning the laser beam in predetermined patterns but are typically not capable of foveation, that is, pointing the beam in random directions, or pointing the beam to different spots at different times not based on a predetermined scan pattern. Diffraction-based liquid-crystal-on- silicon (LCOS) beam steering may be capable of foveation, but the switching rates of typical LCOS systems are relatively low.
[0003] In typical highway traffic, two vehicles traveling in opposite directions may approach each other at a high relative velocity. If one of the vehicles is equipped with a conventional LIDAR system with a relatively low rate of scan, the two vehicles may have traveled a significant distance toward each other between two consecutive scans. On the other hand, if laser beam scanning is limited to a narrow sector in an attempt to improve the rate of scan, then vehicles outside that sector may not be detected. In order to provide effective vehicle detection and collision avoidance, it is desirable that vehicles be equipped with LIDAR systems that are capable of both scanning wide areas in which objects of interest may be found and providing fast updates on objects of interest within those areas, for example, fast- approaching vehicles.
SUMMARY
[0004] Exemplary embodiments of the disclosure are directed to apparatus and methods for dual or multiple beam steering in light detection and ranging (LIDAR) systems.
[0005] In an embodiment, a LIDAR apparatus is provided, the LIDAR apparatus comprising: a first beam scanner configured to scan in one or more of a first plurality of scan patterns; and a second beam scanner configured to scan in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns; and a controller coupled to the first beam scanner and the second beam scanner, the controller configured to drive the first beam scanner based on one or more areas of interest in which one or more targets are likely located and to drive the second beam scanner to monitor one or more identified targets in said one or more areas of interest.
[0006] In another embodiment, a LIDAR apparatus is provided, the LIDAR apparatus comprising: first means for scanning one or more laser beams in one or more of a first plurality of scan patterns; and second means for scanning one or more laser beams in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns; and means for controlling the first means for scanning and the second means for scanning, comprising: means for driving the first beam scanner based on one or more areas of interest in which one or more targets are likely located; and means for driving the second beam scanner to monitor one or more identified targets in said one or more areas of interest.
[0007] In another embodiment, a method of scanning one or more laser beams is provided, the method comprising: scanning one or more laser beams in one or more of a first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located; and scanning one or more laser beams in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns to monitor one or more identified targets in said one or more areas of interest. [0008] In yet another embodiment, an apparatus for scanning one or more laser beams is provided, the apparatus comprising: logic configured to scan one or more laser beams in one or more of a first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located; and logic configured to scan one or more laser beams in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns to monitor one or more identified targets in said one or more areas of interest.
BRIEF DESCRIPTION OF THE DRAWINGS
[0009] The accompanying drawings are presented to aid in the description of embodiments of the disclosure and are provided solely for illustration of the embodiments and not limitation thereof.
[0010] FIG. 1 is a diagram illustrating an example of a traffic environment in which a light detection and ranging (LIDAR) apparatus may be implemented in a vehicle for collision avoidance.
[0011] FIG. 2 is a block diagram illustrating an embodiment of a LIDAR apparatus with dual beam steering.
[0012] FIG. 3 is a flowchart illustrating an embodiment of a method of scanning one or more laser beams by a LIDAR apparatus.
[0013] FIG. 4 is a block diagram illustrating an embodiment of logic configured to scan one or more laser beams by a LIDAR apparatus.
DETAILED DESCRIPTION
[0014] Aspects of the disclosure are described in the following description and related drawings directed to specific embodiments. Alternate embodiments may be devised without departing from the scope of the disclosure. Additionally, well- known elements will not be described in detail or will be omitted so as not to obscure the relevant details of the disclosure.
[0015] The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. Likewise, the term "embodiments" does not require that all embodiments include the discussed feature, advantage or mode of operation.
[0016] The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the embodiments. As used herein, the singular forms "a," "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" or "including," when used herein, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or groups thereof. Moreover, it is understood that the word "or" has the same meaning as the Boolean operator "OR," that is, it encompasses the possibilities of "either" and "both" and is not limited to "exclusive or" ("XOR"), unless expressly stated otherwise. It is also understood that the symbol "/" between two adjacent words has the same meaning as "or" unless expressly stated otherwise. Moreover, phrases such as "connected to," "coupled to" or "in communication with" are not limited to direct connections unless expressly stated otherwise.
[0017] Further, many embodiments are described in terms of sequences of actions to be performed by, for example, elements of a computing device. It will be recognized that various actions described herein can be performed by specific circuits, for example, central processing units (CPUs), graphic processing units (GPUs), digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or various other types of general purpose or special purpose processors or circuits, by program instructions being executed by one or more processors, or by a combination of both. Additionally, these sequence of actions described herein can be considered to be embodied entirely within any form of computer readable storage medium having stored therein a corresponding set of computer instructions that upon execution would cause an associated processor to perform the functionality described herein. Thus, the various aspects of the disclosure may be embodied in a number of different forms, all of which have been contemplated to be within the scope of the claimed subject matter. In addition, for each of the embodiments described herein, the corresponding form of any such embodiments may be described herein as, for example, "logic configured to" perform the described action.
[0018] FIG. 1 is a diagram illustrating an example of a traffic environment in which one or more vehicles may be equipped with light detection and ranging (LIDAR) apparatus for collision avoidance. In the example illustrated in FIG. 1, a first vehicle 102 drives on the same road as second, third and fourth vehicles 104, 106 and 108. The second and third vehicles 104 and 106 move in a direction opposite that of the first vehicle 102, whereas the fourth vehicle 108 moves in the same direction as the first vehicle 102.
[0019] The fourth vehicle 108 may not present an immediate safety concern to the first vehicle 102 because it travels in a different lane and moves in the same direction as the first vehicle 102. Although the third vehicle 106 moves in the direction facing the first vehicle 102, it travels in a different lane and may not present an immediate safety threat to the first vehicle 102. The second vehicle 104, however, may present a more immediate safety threat to the first vehicle 102 because it travels in the same lane as the first vehicle 102 and moves in a direction approaching the first vehicle 102.
[0020] In the example illustrated in FIG. 1, the first vehicle 102 is equipped with a light detection and ranging (LIDAR) apparatus, embodiments of which will be described in further detail below with reference to FIGs. 2-4. In FIG. 1, the LIDAR apparatus in the first vehicle 102 is able to scan a relatively wide sector indicated by angle a, covering an area 110 that includes the positions of the third and fourth vehicles 106 and 108 in the example illustrated in FIG. 1. Although the third and fourth vehicles 106 and 108 in the example illustrated in FIG. 1 may not present immediate threats to the safety of the first vehicle 102, they may change directions and swerve into the lane in which the first vehicle 102 is traveling, for example.
[0021] Furthermore, the LIDAR apparatus in the first vehicle 102 is also capable of tracking or providing fast updates of objects that may present more immediate safety concerns to the first vehicle 102, for example, the second vehicle 104 traveling in the same lane as and in the direction facing the first vehicle 102, in the example illustrated in FIG. 1. In an embodiment, the LIDAR apparatus in the first vehicle 102 is capable of fast beam scanning within a sector indicated by angle β, covering an area 112 smaller than the area 110, to provide fast updates on the distance or velocity of the second vehicle 104 within the area 112.
[0022] FIG. 2 is a block diagram illustrating an embodiment of a LIDAR apparatus
202 which may be implemented in the first vehicle 102 for vehicle detection and collision avoidance. The LIDAR apparatus 202 as illustrated in FIG. 2 is not limited to automobile applications as illustrated in FIG. 1. For example, the LIDAR apparatus 202 may be implemented in a tracked vehicle, a train, a watercraft, or an aircraft for collision avoidance. The LIDAR apparatus 202 may also be implemented in a portable device carried by a pedestrian, or installed on a bicycle, a scooter, or a motorcycle, for example. Moreover, it is not necessary that the LIDAR apparatus 202 be implemented in a moving object. For example, the LIDAR apparatus 202 may be installed at a stationary location to monitor traffic patterns or to provide warnings.
[0023] In the embodiment illustrated in FIG. 2, the LIDAR apparatus 202 comprises a controller 204, a first beam scanner 206 coupled to the controller 204, and a second beam scanner 208 coupled to the controller 204. In an embodiment, the first beam scanner 206 is configured to scan a laser beam in one or more of a first plurality of scan patterns, and the second beam scanner 208 is configured to scan a laser beam in one or more of a second plurality of scan patterns different from the first plurality of scan patterns for the first beam scanner 206.
[0024] In an embodiment, the controller 204 includes a processor 210, a memory
212, which may be coupled to the processor 210 or integral to the processor 210 on a single chip, a first beam scanner driver 214 coupled to the processor 210 and the memory 212, and a second beam scanner driver 216 coupled to the processor 210 and the memory 212. In an embodiment, the first beam scanner driver 214 in the controller 204 is coupled to the first beam scanner 206 and directs the laser beam transmitted by the first beam scanner 206 by issue steering commands to the first beam scanner 206.
[0025] In an embodiment, the second beam scanner driver 216 in the controller 204 is coupled to the second beam scanner 208 and directs the laser beam transmitted by the second beam scanner 208 by issuing commands to the second beam scanner 208 to point the laser beam in a given direction at a given time. Although the LIDAR apparatus in the embodiment shown in FIG. 2 illustrates the first beam scanner driver 214 and the second beam scanner driver 216 as separate blocks from the processor 210 and the memory 212, the beam scanner drivers 214 and 216 may be integral parts of the processor 210 and the memory 212 in another embodiment.
[0026] In the embodiment illustrated in FIG. 2, the first beam scanner 206 is configured to scan a wider area than the second beam scanner 208. In FIG. 2, the first beam scanner 206 is configured to scan the area 110 of the sector covered by angle a, whereas the second beam scanner is configured to scan the area 112 of the sector covered by angle β. In an embodiment, the first beam scanner 206 may be configured to scan in a predetermined scan pattern covering a wide area. For example, the first beam scanner 206 may be programmed to scan in a line-by-line pattern, or a left-right-left-right pattern, or another pattern which allows the laser beam from the first beam scanner 206 to sweep across the area 110 of the sector covered by angle a.
[0027] In an embodiment, the first beam scanner 206 may include a laser beam reflector which is movable or rotatable to sweep a reflected laser beam across the area 110. In an embodiment, the laser beam reflector may be a mechanically controlled reflector, for example, a microelectromechanical system (MEMS) controlled reflector, examples of which are known to persons skilled in the art. In alternate embodiments, other types of scanners that are capable of steering a laser beam to sweep across the area 110 may also be implemented as the first beam scanner 206 in FIG. 2. In an embodiment, the pattern of laser beam scanning by the first beam scanner 206 need not be fixed.
[0028] For example, the first beam scanner driver 214 in the controller 204 may issue steering commands to the first beam driver 206 according to different scan patterns based on various factors. For example, the angle a for the sector to be covered by the first beam scanner 206 may vary based on whether the road on which the vehicle is traveling is a wide highway or a narrow alley, or other factors that may have a bearing on how wide the angle a needs to be. Such factors may be derived from knowledge obtained from other sources, for example, from a navigation system coupled to the LIDAR apparatus 202 as shown in FIG. 2.
[0029] In an embodiment, the first beam scanner 206 covers one or more areas of interest in which one or more targets of interest are likely located. Such areas of interest may be relatively wide in some traffic environments, for example, on multi- lane highways or on roads at or near intersections. In an embodiment, it is not necessary for the first beam scanner 206 to be able to track precisely one or more specific targets in one or more areas of interest covered by the first beam scanner 206.
[0030] In an embodiment, the first beam scanner 206 only needs to obtain target data based on reflections of the laser beam from these targets and conveys the data to the processor 210 in the controller 204, which makes a determination as to which of these targets would be a target of interest. In collision avoidance applications, for example, a target of interest identified in one or more areas scanned by the first beam scanner 206 may be a target closest to the vehicle equipped with the LIDAR apparatus, a target which approaching at a high velocity, or a target which presents a great risk of collision. In an embodiment, more than one target of interest may be identified by the controller 204 for more precise monitoring or tracking.
[0031] In an embodiment, after the controller 204 determines which targets in the area 110 covered by the first beam scanner 206 need more precise monitoring or tracking, second beam scanner driver 216 in the controller 204 issues beam directing commands to the second beam scanner 208 to direct the laser beam transmitted by the second beam scanner to spots within the area 112 of the sector covered by angle β, as shown in FIG. 2. In an embodiment, the second beam scanner 208 comprises a beam scanner configured for foveation, that is, for directing the laser beam in random directions to random spots within the area 112, or alternatively, in preprogrammed directions that appear to be random. In an embodiment, the second beam scanner 208 comprises a diffraction-based beam scanner, for example, a liquid-crystal-on- silicon (LCOS) based beam scanner. In an embodiment, because the second beam scanner 208 only scans a relatively narrow sector defined by angle β, precise and frequent data updates on the targets of interest may be achieved even if the second beam scanner 208 has a relatively low switching rate.
[0032] It will be appreciated that, in the block diagram shown in FIG. 2, the first beam scanner 206 and the second beam scanner 208, which are parts of the LIDAR apparatus 202, may be physically located adjacent to each other. The blocks for the first beam scanner 206 and the second beam scanner 208 are shown as separate blocks in FIG. 2 for illustrating their respective functionalities. Referring to FIG. 1, which illustrates an exemplary traffic environment for the first vehicle 102 in which the LIDAR apparatus 202 of FIG. 2 is implemented, the area 112 of the narrower sector covered by angle β is included within the area 110 of the wider sector covered by angle a.
[0033] In an embodiment, the first beam scanner 206 in FIG. 2 is configured to scan a first laser beam, and a second beam scanner 208 is configured to scan a second laser beam. In alternate embodiments, one or more additional beam scanners may be implemented in the LIDAR apparatus to scan one or more additional areas of interest, for example, areas to the left, right or rear of the first vehicle 102 as shown in FIG. 1.
[0034] In an embodiment, the first beam scanner 206 and the second beam scanner
208 as shown in FIG. 2 may be configured to direct laser beams at the same wavelength. In this embodiment, a single laser source and a beam splitter may be provided in the LIDAR apparatus, and one of the split laser beams may be directed by the first beam scanner 206 for wide area scanning while the other split laser beam may be directed by the second beam scanner 208 for narrow area scanning.
[0035] In an alternate embodiment, the first and second beam scanners 206 and 208 may be configured to direct two laser beams at two different wavelengths. In this embodiment, additional information may be obtained by comparing the reflected signals from a given target of interest at different wavelengths, thereby allowing the LIDAR apparatus to perform further analysis of the target of interest. In a further embodiment, laser beams of different wavelengths may also be directed at other targets or objects in an area of coverage to obtain further knowledge of the targets or objects in the area, to obtain additional information that allows for further analysis of the environment in which the LIDAR apparatus is operating. For example, reflections of laser beams at different wavelengths may yield information on what types of vehicles are in the vicinity of the vehicle equipped with the LIDAR apparatus in a traffic environment.
[0036] FIG. 3 is a flowchart illustrating an embodiment of a method of scanning one or more laser beams by a LIDAR apparatus. In FIG. 3, the step of scanning one or more laser beams in one or more of a first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located is shown in block 302. The step of scanning one or more laser beams in one or more of a second plurality of scan patterns different from one or more of the first plurality of scan patterns to monitor one or more identified targets in one or more areas of interest is shown in block 304.
[0037] In an embodiment, the scanning of one or more laser beams in one or more of the first plurality of scan patterns as shown in block 302 of FIG. 3 is performed by the first beam scanner 206 as shown in FIG. 2. In an embodiment, the first beam scanner 206 may scan a relatively wide area or sector using a predetermined scan pattern. In an embodiment, the scanning of one or more laser beams as shown in block 302 of FIG. 3 may be performed by a laser beam reflector, for example, a mechanically controlled reflector such as a MEMS controlled reflector.
[0038] In an embodiment, the scanning of one or more laser beams in one or more of the second plurality of scan patterns as shown in block 304 of FIG. 3 is performed by the second beam scanner 208 as shown in FIG. 2. In an embodiment, the second beam scanner 208 may scan a relatively narrow area or sector compared to the area or sector scanned by the first beam scanner 206. In an embodiment, the scanning of one or more laser beams as shown in block 304 of FIG. 3 may be performed by a laser beam scanner configured for foveation, that is, for directing the laser beam in random directions to random spots, or alternatively, in preprogrammed directions that appear to be random. In an embodiment, the laser beam scanner that performs the scanning according to block 304 of FIG. 3 comprises a diffraction-based beam scanner, for example, a LCOS based beam scanner.
[0039] FIG. 4 is a block diagram illustrating an embodiment of an apparatus 400 for scanning one or more laser beams by a LIDAR apparatus. In FIG. 4, the apparatus 400 includes logic configured to scanning one or more laser beams in one or more of a first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located, as shown in block 402. The apparatus 400 also includes logic configured to scan one or more laser beams in one or more of a second plurality of scan patterns different from one or more of the first plurality of scan patterns to monitor one or more identified targets in one or more areas of interest is shown in block 404. [0040] In an embodiment, the logic configured to scan one or more laser beams in one or more of the first plurality of scan patterns as shown in block 402 includes logic configured to scan one or more laser beams by a laser beam reflector, for example, a mechanically controlled reflector such as a MEMS controlled reflector. In an embodiment, the logic configured to scan one or more laser beams in one or more of the second plurality of scan patterns as shown in block 404 includes logic configured to scan one or more laser beams by a diffraction-based beam scanner, such as a LCOS based beam scanner.
[0041] In an embodiment, the logic configured to scan one or more laser beams in one or more of the first plurality of scan patterns as shown in block 402 and the logic configured to scan one or more laser beams in one or more of the second plurality of scan patterns as shown in block 404 may be implemented in the controller 204 as shown in FIG. 2. For example, the logic blocks 402 and 404 may be implemented in a hard-wired logic circuit in the processor 210, or alternatively, as a combination of hardware and software in the processor 210 and the memory 212.
[0042] Those of skill in the art will appreciate that information and signals may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips that may be referenced throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or particles, optical fields or particles, or any combination thereof.
[0043] Further, those of skill in the art will appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or a combination of hardware and software. Various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or a combination of hardware and software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosure. [0044] The methods, sequences or algorithms described in connection with the embodiments disclosed herein may be embodied directly in hardware, or in a combination of hardware and a software module executed by a processor. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD- ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor.
[0045] Accordingly, an embodiment of the disclosure can include a computer readable media embodying a method for cache way prediction using partial tags. Accordingly, the disclosure is not limited to illustrated examples and any means for performing the functionality described herein are included in embodiments of the disclosure.
[0046] While the foregoing disclosure shows illustrative embodiments, it should be noted that various changes and modifications could be made herein without departing from the scope of the appended claims. The functions, steps or actions of the method claims in accordance with embodiments described herein need not be performed in any particular order unless expressly stated otherwise. Furthermore, although elements may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.

Claims

CLAIMS WHAT IS CLAIMED IS:
1. A light detection and ranging (LIDAR) apparatus, comprising:
a first beam scanner configured to scan in one or more of a first plurality of scan patterns; and
a second beam scanner configured to scan in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns; and
a controller coupled to the first beam scanner and the second beam scanner, the controller configured to drive the first beam scanner based on one or more areas of interest in which one or more targets are likely located and to drive the second beam scanner to monitor one or more identified targets in said one or more areas of interest.
2. The LIDAR apparatus of claim 1, wherein the first beam scanner is configured to scan a wider area than the second beam scanner.
3. The LIDAR apparatus of claim 1, wherein the first beam scanner comprises a laser beam reflector.
4. The LIDAR apparatus of claim 3, wherein the laser beam reflector comprises a mechanically controlled reflector.
5. The LIDAR apparatus of claim 3, wherein the laser beam reflector comprises a microelectromechanical system (MEMS) controlled reflector.
6. The LIDAR apparatus of claim 1, wherein the second beam scanner comprises a beam scanner configured for foveation.
7. The LIDAR apparatus of claim 1, wherein the second beam scanner comprises a diffraction-based beam scanner.
8. The LIDAR apparatus of claim 7, wherein the diffraction-based beam scanner comprises a liquid-crystal-on-silicon (LCOS) based beam scanner.
9. The LIDAR apparatus of claim 1, wherein the first beam scanner is configured to scan a first laser beam, wherein the second beam scanner is configured to scan a second laser beam, and wherein the first and second laser beams have the same wavelength.
10. The LIDAR apparatus of claim 1, wherein the first beam scanner is configured to scan a first laser beam, wherein the second beam scanner is configured to scan a second laser beam, and wherein the first and second laser beams have different wavelengths.
11. The LIDAR apparatus of claim 10, wherein the controller is further configured to distinguish targets of different materials based on reflections of the first laser beam and the second laser beam at different wavelengths.
12. A light detection and ranging (LIDAR) apparatus, comprising:
first means for scanning one or more laser beams in one or more of a first plurality of scan patterns; and
second means for scanning one or more laser beams in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns; and
means for controlling the first means for scanning and the second means for scanning, comprising:
means for driving the first beam scanner based on one or more areas of interest in which one or more targets are likely located; and
means for driving the second beam scanner to monitor one or more identified targets in said one or more areas of interest.
13. The LIDAR apparatus of claim 12, wherein the first means for scanning one or more laser beams in one or more of the first plurality of scan patterns is configured to scan at a faster rate than the second means for scanning one or more laser beams in one or more of the second plurality of scan patterns different from said one or more of the first plurality of scan patterns.
14. The LIDAR apparatus of claim 12, wherein the first means for scanning one or more laser beams in one or more of the first plurality of scan patterns comprises a laser beam reflector.
15. The LIDAR apparatus of claim 14, wherein the laser beam reflector comprises a mechanically controlled reflector.
16. The LIDAR apparatus of claim 14, wherein the laser beam reflector comprises a microelectromechanical system (MEMS) controlled reflector.
17. The LIDAR apparatus of claim 12, wherein the second means for scanning one or more laser beams in one or more of the second plurality of scan patterns different from said one or more of the first plurality of scan patterns comprises a beam scanner configured for foveation.
18. The LIDAR apparatus of claim 12, wherein the second means for scanning one or more laser beams in one or more of the second plurality of scan patterns different from said one or more of the first plurality of scan patterns comprises a diffraction-based beam scanner.
19. The LIDAR apparatus of claim 18, wherein the diffraction-based beam scanner comprises a liquid-crystal-on-silicon (LCOS) based beam scanner.
20. The LIDAR apparatus of claim 12, wherein the first means for scanning one or more laser beams in one or more of the first plurality of scan patterns is configured to scan a first laser beam, and wherein the second means for scanning one or more laser beams in one or more of the second plurality of scan patterns different from said one or more of the first plurality of scan patterns is configured to scan a second laser beam.
21. The LIDAR apparatus of claim 20, wherein the first and second laser beams have the same wavelength.
22. The LIDAR apparatus of claim 20, wherein the first and second laser beams have different wavelengths.
23. A method of scanning one or more laser beams, comprising:
scanning one or more laser beams in one or more of a first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located; and
scanning one or more laser beams in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns to monitor one or more identified targets in said one or more areas of interest.
24. The method of claim 23, wherein scanning one or more laser beams in one or more of the first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located is performed by a laser beam reflector, and wherein scanning one or more laser beams in one or more of the second plurality of scan patterns different from said one or more of the first plurality of scan patterns to monitor one or more identified targets in said one or more areas of interest is performed by a diffraction-based beam scanner.
25. The method of claim 23, wherein scanning one or more laser beams in one or more of the first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located comprises scanning a first laser beam, and wherein scanning one or more laser beams in one or more of the second plurality of scan patterns different from said one or more of the first plurality of scan patterns to monitor one or more identified targets in said one or more areas of interest comprises scanning a second laser beam.
26. The method of claim 25, wherein the first and second laser beams have the same wavelength.
27. The method of claim 25, wherein the first and second laser beams have different wavelengths.
28. An apparatus for scanning one or more laser beams, comprising: logic configured to scan one or more laser beams in one or more of a first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located; and
logic configured to scan one or more laser beams in one or more of a second plurality of scan patterns different from said one or more of the first plurality of scan patterns to monitor one or more identified targets in said one or more areas of interest.
29. The apparatus of claim 28, wherein the logic configured to scan one or more laser beams in one or more of the first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located comprises logic configured to scan one or more laser beams by a laser beam reflector, and wherein the logic configured to scan one or more laser beams in one or more of the second plurality of scan patterns different from said one or more of the first plurality of scan patterns to monitor one or more identified targets in said one or more areas of interest comprises logic configured to scan one or more laser beams by a diffraction-based beam scanner.
30. The apparatus of claim 27, wherein the logic configured to scan one or more laser beams in one or more of the first plurality of scan patterns based on one or more areas of interest in which one or more targets are likely located comprises logic configured to scan a first laser beam, and wherein the logic configured to scan one or more laser beams in one or more of the second plurality of scan patterns different from said one or more of the first plurality of scan patterns to monitor one or more identified targets in said one or more areas of interest comprises logic configured to scan a second laser beam.
EP16854598.6A 2015-09-20 2016-09-15 Light detection and ranging (lidar) system with dual beam steering Active EP3350620B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US14/859,341 US10061020B2 (en) 2015-09-20 2015-09-20 Light detection and ranging (LIDAR) system with dual beam steering
PCT/US2016/051859 WO2017105568A2 (en) 2015-09-20 2016-09-15 Light detection and ranging (lidar) system with dual beam steering

Publications (2)

Publication Number Publication Date
EP3350620A2 true EP3350620A2 (en) 2018-07-25
EP3350620B1 EP3350620B1 (en) 2024-03-06

Family

ID=58277124

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16854598.6A Active EP3350620B1 (en) 2015-09-20 2016-09-15 Light detection and ranging (lidar) system with dual beam steering

Country Status (6)

Country Link
US (1) US10061020B2 (en)
EP (1) EP3350620B1 (en)
JP (1) JP2018529099A (en)
KR (1) KR20180054764A (en)
CN (1) CN108027438B (en)
WO (1) WO2017105568A2 (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11092672B2 (en) * 2016-08-31 2021-08-17 Samsung Electronics Co., Ltd. Optical scanning device and LIDAR system including the same
JP7031137B2 (en) * 2017-04-10 2022-03-08 凸版印刷株式会社 Laser scanning device
US9950685B1 (en) * 2017-07-27 2018-04-24 Feniex Industries, Inc. 360 degree intrusion detection and warning system
DE102017215614A1 (en) * 2017-09-05 2019-03-07 Osram Gmbh Stochastically clocked imaging of a lidar system
EP3460519A1 (en) * 2017-09-25 2019-03-27 Hexagon Technology Center GmbH Laser scanner
EP3460520B1 (en) * 2017-09-25 2023-07-19 Hexagon Technology Center GmbH Multi-beam laser scanner
US20210065553A1 (en) * 2018-03-05 2021-03-04 Mitsubishi Electric Corporation Information processing device, information processing method, and computer readable medium
US20210096257A1 (en) * 2018-03-16 2021-04-01 Nec Corporation Optical monitoring apparatus and method
US10838045B2 (en) * 2018-10-02 2020-11-17 Blackmore Sensors & Analytics, LLC. Method and system for optimizing scanning of coherent lidar
WO2020092953A1 (en) * 2018-11-02 2020-05-07 Waymo Llc Synchronization of multiple rotating sensors of a vehicle
KR20240033176A (en) 2019-01-04 2024-03-12 오로라 오퍼레이션스, 인크. Method and system for refractive beam-steering
US11556000B1 (en) 2019-08-22 2023-01-17 Red Creamery Llc Distally-actuated scanning mirror
EP4040108A4 (en) * 2019-10-01 2022-11-23 Panasonic Intellectual Property Management Co., Ltd. Distance measurement device and control method
EP4119975A4 (en) * 2020-03-11 2023-08-09 Panasonic Intellectual Property Management Co., Ltd. Distance measuring device
US10942277B1 (en) * 2020-06-19 2021-03-09 Aurora Innovation, Inc. LIDAR system

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6008925A (en) * 1991-06-07 1999-12-28 Advanced Laser Technologies, Inc. Light beam scanning apparatus and method
US6262432B1 (en) * 1992-12-03 2001-07-17 Brown & Sharpe Surface Inspection Systems, Inc. High speed surface inspection optical apparatus for a reflective disk using gaussian distribution analysis and method therefor
IL110611A (en) 1994-08-09 1997-01-10 Israel State Apparatus and method for laser imaging
US7277187B2 (en) * 2001-06-29 2007-10-02 Quantronix, Inc. Overhead dimensioning system and method
US6473241B1 (en) 2001-11-27 2002-10-29 The United States Of America As Represented By The Secretary Of The Air Force Wide field-of-view imaging system using a reflective spatial light modulator
CN1274541C (en) * 2003-12-12 2006-09-13 清华大学 Vehicle mounted scanning type laser radar detection system and method for detecting dangerous articles ahead
US20090195790A1 (en) * 2005-09-02 2009-08-06 Neptec Imaging system and method
DE102005054135A1 (en) * 2005-11-14 2007-05-16 Bosch Gmbh Robert Procedure for environment detection
US8050863B2 (en) 2006-03-16 2011-11-01 Gray & Company, Inc. Navigation and control system for autonomous vehicles
US7501616B2 (en) * 2006-05-25 2009-03-10 Microvision, Inc. Method and apparatus for capturing an image of a moving object
US8493445B2 (en) * 2006-05-31 2013-07-23 Sigma Space Corp Scanner/optical system for three-dimensional lidar imaging and polarimetry
US8027029B2 (en) 2007-11-07 2011-09-27 Magna Electronics Inc. Object detection and tracking system
WO2009126264A2 (en) * 2008-04-06 2009-10-15 David Chaum Proximal image projection system
US8744336B2 (en) * 2008-08-27 2014-06-03 Qualcomm Incorporated Interference detection apparatus and method
US8126642B2 (en) * 2008-10-24 2012-02-28 Gray & Company, Inc. Control and systems for autonomously driven vehicles
EP2519868A1 (en) * 2009-12-29 2012-11-07 Qualcomm Mems Technologies, Inc. Illumination device with metalized light-turning features
LU91737B1 (en) 2010-09-17 2012-03-19 Iee Sarl Lidar imager
US20120075686A1 (en) * 2010-09-29 2012-03-29 Microvision, Inc. Beam Profile Control in a Scanned Beam Display
US9071742B2 (en) * 2011-07-17 2015-06-30 Ziva Corporation Optical imaging with foveation
US9671566B2 (en) * 2012-06-11 2017-06-06 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
WO2014014838A2 (en) 2012-07-15 2014-01-23 2R1Y Interactive illumination for gesture and/or object recognition
US20140063189A1 (en) * 2012-08-28 2014-03-06 Digital Signal Corporation System and Method for Refining Coordinate-Based Three-Dimensional Images Obtained from a Three-Dimensional Measurement System
US9074878B2 (en) * 2012-09-06 2015-07-07 Faro Technologies, Inc. Laser scanner
US20140240810A1 (en) 2012-11-02 2014-08-28 ISC8 Inc. MEMS Drive and Beam-Steering Apparatus
US8818609B1 (en) 2012-11-15 2014-08-26 Google Inc. Using geometric features and history information to detect features such as car exhaust in point maps
WO2014082035A1 (en) 2012-11-25 2014-05-30 Nistica, Inc. Wss using multiple technology switching elements
US9857472B2 (en) * 2013-07-02 2018-01-02 Electronics And Telecommunications Research Institute Laser radar system for obtaining a 3D image
JP2015169541A (en) * 2014-03-07 2015-09-28 オムロンオートモーティブエレクトロニクス株式会社 Laser radar device and object detection method
US9625582B2 (en) 2015-03-25 2017-04-18 Google Inc. Vehicle with multiple light detection and ranging devices (LIDARs)
CN104914445B (en) * 2015-05-29 2017-07-07 长春理工大学 For the combined type scanning system of laser radar

Also Published As

Publication number Publication date
WO2017105568A2 (en) 2017-06-22
KR20180054764A (en) 2018-05-24
CN108027438B (en) 2022-04-26
EP3350620B1 (en) 2024-03-06
CN108027438A (en) 2018-05-11
US10061020B2 (en) 2018-08-28
JP2018529099A (en) 2018-10-04
US20170082735A1 (en) 2017-03-23
WO2017105568A3 (en) 2017-09-08

Similar Documents

Publication Publication Date Title
US10061020B2 (en) Light detection and ranging (LIDAR) system with dual beam steering
CN107972665B (en) Device for controlling vehicles at an intersection
US20200302196A1 (en) Traffic Signal Analysis System
JP4371115B2 (en) Object detection device
US11852746B2 (en) Multi-sensor fusion platform for bootstrapping the training of a beam steering radar
JP2022097561A (en) Tailoring sensor emission power to map, vehicle state, and environment
WO2018055513A2 (en) Methods circuits devices assemblies systems and functionally associated machine executable code for light detection and ranging based scanning
JP6323064B2 (en) Traveling lane identification device, lane change support device, traveling lane identification method
JP2005127909A (en) Scanning method of radar
JP2006226931A (en) On-vehicle radar system
US10679506B2 (en) Method of tracking a plurality of objects in the vicinity of a host vehicle
US11900814B2 (en) Controlling articulating sensors of an autonomous vehicle
US10907962B2 (en) Driving assistance system mounted in vehicle
US20230161047A1 (en) Sensor Steering for Multi-Directional Long-Range Perception
JP7028982B2 (en) Radar processing device
JP6544168B2 (en) Vehicle control device and vehicle control method
JP2005104462A (en) Traffic direction recognition method and device
JP5163084B2 (en) Object detection device
KR20230108595A (en) Vehicle and control method thereof
US20230278483A1 (en) Vehicle control device
Dickmann et al. Environmental perception for future integrated safety systems
JP2004220233A (en) Object recognition device and recognition method
EP3276588B1 (en) Cross traffic detection system for a vehicle
JPH10288666A (en) Vehicle identification device and vehicle distance measuring device
KR20230171112A (en) Vehicle and control method thereof

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180404

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20210317

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602016086204

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G01S0017420000

Ipc: G01S0017870000

Ref country code: DE

Free format text: PREVIOUS MAIN CLASS: G01S0017420000

Ipc: G01S0017870000

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20231027

RIC1 Information provided on ipc code assigned before grant

Ipc: G01S 17/42 20060101ALI20231016BHEP

Ipc: G01S 17/931 20200101ALI20231016BHEP

Ipc: G01S 7/481 20060101ALI20231016BHEP

Ipc: G01S 17/87 20060101AFI20231016BHEP

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016086204

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D