EP4388341A1 - Scanning system for range detection sensor - Google Patents
Scanning system for range detection sensorInfo
- Publication number
- EP4388341A1 EP4388341A1 EP21847768.5A EP21847768A EP4388341A1 EP 4388341 A1 EP4388341 A1 EP 4388341A1 EP 21847768 A EP21847768 A EP 21847768A EP 4388341 A1 EP4388341 A1 EP 4388341A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- doe
- mems mirror
- laser
- fov
- previous
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/481—Constructional features, e.g. arrangements of optical elements
- G01S7/4817—Constructional features, e.g. arrangements of optical elements relating to scanning
Definitions
- the present application describes a system and method to scan the Field of View ( FoV) of interest of a LiDAR system .
- FoV Field of View
- LiDAR Light Detecting and Ranging
- a scanning LiDAR sensor the emitted laser beam scans the FoV of interest and obtains the distance usually by measuring the time-of- f light ( ToF) a laser pulse takes to travel to a speci fic target and to return to the sensor, or by using techniques based on frequency, amplitude or polari zation modulation .
- ToF time-of- f light
- di fferent techniques that can be used to scan the laser beam over the target FoV .
- Some examples include the mechanical rotation of the full sending and receiving parts of the sensor, galvanometer scanning mirrors , electrooptic scanners based on crystal liquids , integrated optical phased-array antennas or scanners based on 1-D or 2-D micro- electro-mechanical systems (MEMS ) mirrors .
- MEMS micro- electro-mechanical systems
- MEMS-based scanning mirrors have been receiving high interest from the automotive industry as a particularly relevant platform to build a compact , low-power consumption and lightweight LiDAR sensor .
- These devices can steer an incoming laser beam to di f ferent angles of the FoV driven by an applied external signal , either through electromagnetic, electrostatic or piezoelectric actuation, or even a combination of multiple actuation mechanisms .
- the present invention describes a system comprising a laser source adapted to emit a light beam; a set of optical elements adapted to collect and modi fy the emitted light beam by the laser source ; and a reflective apparatus , adapted to reflect and increase the FoV range of the modi fied light beam from the set of optical elements towards the surrounding environment of the sensor until it reaches a fixed or moving target .
- the system comprises a set of receiving optics and a photodetector .
- the system comprises a set of reshaping optical elements adapted to reshape the reflected light beam from the reflective apparatus .
- the modi fied reflected light beam with increased FoV comprises at least one of a laser "line beam” shape , a laser “multispot” shape or a Nh x Nv laser “multispot” shape .
- the reflective apparatus comprises a MEMS mirror and a DOE .
- the MEMS mirror comprises one of single scanning axis or double scanning axis .
- the MEMS mirror and a DOE are arranged separately or embedded together in a single element inside the reflective apparatus .
- the photodetector comprises a matrix with a set of pixels , said matrix being characteri zed by an angular resolution determined by the size of the pixels and by the focal length of the receiving optics .
- the resulting modi fied light beam from the set of optical elements reaches the DOE in an angle of incidence determined by the scanning angle of the MEMS mirror .
- the scanning angle of the MEMS mirror and angle of incidence at the DOE are variably adjusted to allow the increase of the FoV.
- the present application describes a system and method to scan the Field of View (FoV) of interest of a LiDAR system.
- FoV Field of View
- Present invention combines micro-electro-mechanical systems (MEMS) mirror with diffractive optical elements (DOEs) as a solution to increase the FoV or alleviate the design requirements of a MEMS-based LiDAR.
- MEMS micro-electro-mechanical systems
- DOEs diffractive optical elements
- the DOE creates a specific pattern (multispot or line beam) that is then swept over a target FoV by the MEMS mirror. It is also disclosed how to combine the DOE with the MEMS mirrors in a single device, embedding the DOEs that produce a multispot pattern or line beam (instead of a simple grating) , allowing to greatly simplify the alignment and complexity of the system leading to a more robust solution.
- the present invention aims to solve several existing problems present in state-of-the-art technologies, particularly :
- the MEMS + DOE approach can achieve a similar FoV scanning range as with a single MEMS mirror, but with smaller rotation angles of the MEMS mirror ;
- Fig . 1 - illustrates the block diagram of the LiDAR system, wherein the reference numbers refer to :
- Fig. 2 - illustrates a schematic representation of MEMS mirror + DOE subsystem based on a laser "line beam” DOE with separate MEMS mirror and separate DOE, wherein the reference numbers refer to:
- Fig. 3 - illustrates a schematic representation of MEMS mirror + DOE subsystem based on a laser "line beam” DOE with MEMS mirror and DOE combined in a single element, wherein the reference numbers refer to:
- Fig. 5 - illustrates a schematic representation of MEMS mirror + DOE subsystem based on a "multispot" DOE generating four separate laser spots with separate MEMS mirror and separate DOE, wherein the reference numbers refer to:
- Fig. 6 - illustrates a schematic representation of MEMS mirror + DOE subsystem based on a "multispot" DOE generating four separate laser spots with MEMS mirror and DOE combined in a single element, wherein the reference numbers refer to:
- the inner rectangle delimited by a dashed line indicates the maximum FoV of the MEMS mirror for a single beam, without the DOE .
- the dashed arrows represent the directions and amplitude of the MEMS mirror scanning .
- Fig . 8 - illustrates a schematic representation of MEMS mirror + DOE subsystem based on a Nh x Nv "multispot" DOE generating Nh x Nv multiple separate laser spots with separate MEMS mirror and separate DOE , wherein the reference numbers refer to :
- Fig . 9 - illustrates a schematic representation of MEMS mirror + DOE subsystem based on a Nh x Nv "multispot" DOE generating Nh x Nv multiple separate laser spots with MEMS mirror and DOE combined in a single element , wherein the reference numbers refer to :
- the inner rectangle delimited by a dashed line indicates the maximum FoV of the MEMS mirror for a single beam, without the DOE.
- the dashed arrows represent the directions and amplitude of the MEMS mirror scanning.
- Fig. 11 Illustration of the resulting single photodetector pixels per spot of the Nh x Nv laser spots imaged at the photodetector matrix with of the combined MEMS mirror + DOE subsystem, wherein the reference numbers refer to:
- the inner rectangle delimited by a dashed line indicates the maximum FoV of the MEMS mirror for a single beam, without the DOE.
- the dashed arrows represent the directions and amplitude of the MEMS mirror scanning.
- the invention herein reported describes a method and apparatus for a scanning subsystem in a LiDAR sensor.
- the invention relies on combining DDEs with MEMS mirrors to scan a specific FoV area.
- the LiDAR system (100) comprises a laser source (1) responsible for emitting the laser pulse light beams.
- a laser source (1) can be built using different types of lasers, e.g., edgeemitting (Fabry-Perot) lasers, vertical-cavity surfaceemitting lasers (VCSELs) , fiber lasers, etc.
- the laser light emitted by the laser source (1) then goes through a set of optical elements (2) , collimating or focusing lens, that are responsible for collimating or focusing the laser beam onto the MEMS mirror + DOE subsystem (3) .
- the reflective apparatus (3) comprises a MEMS mirror (31) with single scanning axis for laser beam steering (1-D MEMS mirror) and a transmissive DOE (32) that is especially designed to produce a laser "line beam” DOE (80) .
- the laser source (1) generates a laser light beam that passes through the set of optical elements (2) (collimating optical lens) , before reaching the single scanning axis MEMS mirror (31) . It is assumed here that the laser beam is first collimated before the MEMS mirror (31) , but other configurations are possible, e.g., using a lens (2) to focus the laser beam on the MEMS mirror (31) .
- the MEMS mirror (31) then reflects the laser beam towards the DOE set (32) .
- the angle of incidence at which the laser beam reaches the DOE (32) is determined by the scanning angle of the MEMS mirror (31) .
- the DOE (32) is responsible for spreading the laser light beam (80) perpendicularly to the scanning axis.
- the laser line beam (80) illuminates the entire FoV (e.g., along either in the horizontal or vertical direction) , as in a flash LiDAR, and a matrix (81) in the receiving photodetector (7) must be used to resolve the different angular positions of the received reflection light.
- a schematic representation of the resulting reflected MEMS mirror + DOE subsystem received laser light beam (80) in the matrix (81) of the photodetector (7) is imaged in Figure 4.
- the entire FoV can thus be scanned by sweeping the line beam perpendicularly to the line, which can be achieved through the rotation of the MEMS mirror (31) .
- the proposed invention can be considered as a hybrid approach that combines a flash illumination strategy (along the direction of the line) and scanning (perpendicularly to the line) .
- the invention requires a two- dimensional photodetector (7) with a matrix (81) adapted to resolve the different angular positions of the reflected light.
- a single scanning axis photodetector array that discriminates the different angles along the direction of the array via focal plane imaging combined with an additional single scanning axis scanning mirror at the receiver that sweeps in a direction perpendicular to the line and the single scanning axis photodetector array.
- the additional mirror must be therefore synchronized with the MEMS mirror at the emitting part of the system.
- the proposed embodiment as some limitations related to the geometric arrangement of the MEMS mirror (31) and the DOE (32) . Whenever the MEMS mirror (31) redirects the beam to a different angle, the laser beam does not hit the DOE
- the DOE and MEMS mirror are combined in a single element (33) , embedded together inside the reflective apparatus, producing the diffraction pattern of the laser line beam DOE (80) on the surface of the embedded MEMS mirror
- the MEMS mirror with the embedded diffraction pattern single element (33) can simultaneously produce the laser line beam (80) and scan it over the perpendicular direction.
- the proposed approach not only the main limitation of the previous embodiment of Figure 2 is overcome, but the overall complexity of the system also simplifies .
- the receiving photodetector (7) in one of the proposed embodiments of the invention, resorts to the use of a photodetector matrix (81) , which can include, but not limited to, photodiodes, phototransistors, avalanche photodiodes (APDs) , or single-photon avalanche photodiodes (SPADs) .
- a photodetector matrix (81) can include, but not limited to, photodiodes, phototransistors, avalanche photodiodes (APDs) , or single-photon avalanche photodiodes (SPADs) .
- the angular resolution is determined by the number and size of the pixels (82) in the photodetector matrix (81) and by the focal length of the objective lens / receiving optics (6) at the receiving part of the sensor (100) .
- each pixel (82) of the matrix (81) corresponds to a specific angular position, similarly to what happens in a standard camera (focal plane imaging technique) .
- the sensor (100) can read the tilt angle of the MEMS mirror (31) and translate it into an angular position in the FoV.
- the MEMS + DOE subsystem (3) comprises a MEMS mirror (31) adapted to steer the emitted light beam in two different directions (2-D MEMS mirror) and a shaped DOE (32) that splits the emitted light beam by the laser source into multiple beams (multispot DOE) , each beam pointing to a different angular position.
- the DOE (32) splits the beam into four spots (83) arranged in a rectangular configuration.
- the angle of the dual scanning axis MEMS mirror (31) By changing the angle of the dual scanning axis MEMS mirror (31) , the angle of incidence at the DOE (32) and, consequently, the output angle of the multiple emitted laser light beams (83) can be adjusted.
- the multiple laser beams (83) can scan the entire FoV.
- the main advantage of the proposed arrangement when compared to using a single scanning axis MEMS mirror, is the possibility to increase the FoV from the 0MEMS,V angle (92) to 0MEMS,V (92) + 0DOE,V (94) angle in the vertical direction, and from 0MEMS,H angle (95) to 0MEMS,H (95) + 0DOE,h (93) angle, where 0MEMS,V (92) and 0MEMS,H (95) are the vertical and horizontal FoV angles achieved using only the MEMS mirror (31) , and 0DOE,V (94) and 0DOE,H (93) are the vertical and horizontal angular separations between the beam spots (83) of the DOE (32) .
- the light beams reflected by the target and imaged by the receiving optics (6) on the matrix (81) of the receiving photodetector (7) for the proposed embodiment are schematically represented in Figure 7. If no DOE (32) is used in combination with the MEMS mirror (31) in the MEMS + DOE subsystem (3) , only a single laser spot will be imaged at the matrix (81) of the receiver photodetector (7) . Such imaged laser beam is formed in a certain position inside the dashed rectangle in Figure 7, which depends on the deflection angle of the MEMS mirror (31) . When the DOE (32) is added, such beam is splitted into four new laser beams (83) at angles corresponding to combinations of ⁇ 0DOE,V/2 vertically, and ⁇ 0DOE,H/2 horizontally.
- the DOE (32) is designed to split the emitted light beam into a rectangular Nh x Nv array of multiple laser narrow spots (84) , with Nh and Nv being the number of spots in the horizontal and vertical directions, respectively.
- the angular separation between adjacent spots is purposely designed to be large in order to achieve a large FoV.
- Each generated Nh x Nv array of multiple laser spots (84) has a low divergence angle, which must be equal to the minimum angular resolution required for the whole LiDAR system (100) .
- the LiDAR system (100) can only map a discrete set of angles in the FoV with coarse spacing, which corresponds to the FoV regions illuminated by each of the multispot laser beams (84) generated by the DOE (32) .
- the receiving optics (6) collect and focus the reflected light from the illuminated targets onto the matrix (81) of the receiving photodetector (7) , which images the incoming reflected light as a set of discrete spots (84) , as shown in Figure 10.
- Each of such spots (84) corresponds to a specific laser beam generated by the DOE (32) and, consequently, to a different angle of the FoV.
- the multispot beam generated by the DOE (32) is able to illuminate multiple targets simultaneously within almost the entire FoV, but with a coarse angular resolution.
- a finer resolution can be obtained by tilting the MEMS mirror (31) axis with a relatively small angular step. As discussed before, this changes the angle of incidence of the emitted laser beam on the DOE (32) and, consequently, the angles of the multiple emitted light beams after the DOE (32) .
- the proposed approach can be seen as an hybrid flash/ scanning system where the multispot DOE (32) is responsible to flash a discrete and coarse set of angles over the entire FoV, whereas the MEMS mirror (31) is responsible for scanning the multiple beams with a much finer angular resolution.
- 0MEMS,H (95) 0DOE,H (93) angle
- 0MEMS,V (92) 0DOE,V (94) angle, with 0DOE,H (93) and 0DOE,V (94) now being the horizontal and vertical angular separation between adjacent spots (84) .
- 0MEMS,H (95) 0DOE,H (93) angle
- 0MEMS,V (92) 0DOE,V (94) angle, with 0DOE
- the "multispot" DOE (32) and MEMS mirror (31) are combined in a single element (33) , wherein the diffraction pattern of the DOE (32) is embedded at the surface of the MEMS mirror (31) .
- the photodetector matrix (81) As concerns the receiver side apparatus and the embodiments illustrated in both Figure 8 and Figure 9, two possible alternatives exist for the photodetector matrix (81) .
- the maximum angular resolution is defined by the size of the pixel (82) and the focal length of the receiving optics (6) .
- the resolution would be defined by the pixel size (82) and focal length of the receiving optics (6) .
- the invention is also compatible with super resolution techniques, for instance, by measuring the intensity of the received light beam in neighbouring pixels (82) and computing the so-called centroid position.
- each laser spot (84) of the reflected multispot beam may be focused at a slightly different location within a macropixel, depending on the tilt angle of the combined MEMS mirror of the single element (33) , but it always stays focused on the same pixel (82) .
- this approach provides an angular discrimination with coarse resolution, equal to the angular spacing between the adj acent spots ( 84 ) .
- each pixel ( 82 ) of the photodetector array ( 7 ) is responsible for defining an angular region in space from which the reflected rays may be coming from and the tilt angle position of the MEMS mirror defines the angle within this region with higher precision .
- This alternative has the advantage of not requiring a pixel density at the photodetector matrix as high as for the alternative in Figure 10 , but at the expense of requiring to read the tilt angle position of the MEMS mirror with high precision and accuracy .
- it is also impaired by "blind zones" between adj acent pixels , in which the detector is not sensitive .
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Optical Radar Systems And Details Thereof (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PT11765121 | 2021-12-17 | ||
| PCT/IB2021/062057 WO2023111667A1 (en) | 2021-12-17 | 2021-12-21 | Scanning system for range detection sensor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4388341A1 true EP4388341A1 (en) | 2024-06-26 |
Family
ID=80113472
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP21847768.5A Pending EP4388341A1 (en) | 2021-12-17 | 2021-12-21 | Scanning system for range detection sensor |
Country Status (2)
| Country | Link |
|---|---|
| EP (1) | EP4388341A1 (en) |
| WO (1) | WO2023111667A1 (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN121232371A (en) * | 2024-06-21 | 2025-12-30 | 深圳引望智能技术有限公司 | An optical module, detection device and terminal equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019041268A1 (en) * | 2017-08-31 | 2019-03-07 | SZ DJI Technology Co., Ltd. | A solid state light detection and ranging (lidar) system |
| US11662435B2 (en) * | 2019-04-04 | 2023-05-30 | Liturex (Guangzhou) Co. Ltd | Chip scale integrated scanning LiDAR sensor |
| US11422266B2 (en) * | 2020-07-21 | 2022-08-23 | Leddartech Inc. | Beam-steering devices and methods for LIDAR applications |
-
2021
- 2021-12-21 WO PCT/IB2021/062057 patent/WO2023111667A1/en not_active Ceased
- 2021-12-21 EP EP21847768.5A patent/EP4388341A1/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023111667A1 (en) | 2023-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11422239B2 (en) | Lidar sensor for a lidar system | |
| US10996322B2 (en) | Lidar sensor | |
| US10739460B2 (en) | Time-of-flight detector with single-axis scan | |
| US10305247B2 (en) | Radiation source with a small-angle scanning array | |
| CN103038664B (en) | active illumination scanning imager | |
| US11561287B2 (en) | LIDAR sensors and methods for the same | |
| US6741082B2 (en) | Distance information obtaining apparatus and distance information obtaining method | |
| US11313954B2 (en) | Optoelectronic sensor and method for detecting three-dimensional image data | |
| US11914074B2 (en) | Optoelectronic sensor and method for the detection of objects | |
| CN105393138A (en) | Opto-electronic detection device and method for scanning the surroundings of a motor vehicle | |
| CN110300900B (en) | Lidar sensor for sensing objects | |
| CN111373284B (en) | Laser scanners such as lidar systems for driver assistance systems | |
| CN110312947B (en) | Lidar sensor for detecting objects | |
| CN113544542A (en) | LIDAR with Phase Light Modulator | |
| EP2362237A1 (en) | Laser radar device | |
| CN111175721A (en) | LIDAR sensor and method for LIDAR sensor | |
| WO2023111667A1 (en) | Scanning system for range detection sensor | |
| KR102493422B1 (en) | 2-Dimensional scanning optical system by simple objective lens sequential actuation | |
| US11815676B2 (en) | Active pushbroom imaging system using a micro-electro-mechanical system (MEMS) micro-mirror array (MMA) | |
| CN108885260B (en) | Time-of-flight detector with single axis scanning | |
| CA2547915A1 (en) | Optical system | |
| US11762066B2 (en) | Multi-beam scanning system | |
| JP2021110698A (en) | Optical three-dimensional shape measurement device | |
| US11940564B2 (en) | Laser radar device | |
| US20240201339A1 (en) | Time Multiplexing Flash Light Detection and Ranging Apparatus and Operating Method Thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20240322 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20250523 |