CN112771410A - 集成激光雷达图像传感器设备和系统以及相关的操作方法 - Google Patents

集成激光雷达图像传感器设备和系统以及相关的操作方法 Download PDF

Info

Publication number
CN112771410A
CN112771410A CN201980060777.8A CN201980060777A CN112771410A CN 112771410 A CN112771410 A CN 112771410A CN 201980060777 A CN201980060777 A CN 201980060777A CN 112771410 A CN112771410 A CN 112771410A
Authority
CN
China
Prior art keywords
pixels
light
tof
pixel
output
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201980060777.8A
Other languages
English (en)
Chinese (zh)
Inventor
豪德·芬克尔斯坦
迪特里希·德林格尔
斯科特·伯勒斯
布伦特·费希尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Feeling Photonics
Sense Photonics Inc
Original Assignee
Feeling Photonics
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Feeling Photonics filed Critical Feeling Photonics
Publication of CN112771410A publication Critical patent/CN112771410A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483—Details of pulse systems
    • G01S7/486—Receivers
    • G01S7/4861—Circuits for detection, sampling, integration or read-out
    • G01S7/4863—Detector arrays, e.g. charge-transfer gates
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/86—Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4814—Constructional features, e.g. arrangements of optical elements of transmitters alone
    • G01S7/4815—Constructional features, e.g. arrangements of optical elements of transmitters alone using multiple transmitters
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/481—Constructional features, e.g. arrangements of optical elements
    • G01S7/4816—Constructional features, e.g. arrangements of optical elements of receivers alone
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483—Details of pulse systems
    • G01S7/484—Transmitters
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483—Details of pulse systems
    • G01S7/486—Receivers
    • G01S7/487—Extracting wanted echo signals, e.g. pulse detection
    • G01S7/4876—Extracting wanted echo signals, e.g. pulse detection by removing unwanted signals
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/491—Details of non-pulse systems
    • G01S7/4912—Receivers
    • G01S7/4913—Circuits for detection, sampling, integration or read-out
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/93—Lidar systems specially adapted for specific applications for anti-collision purposes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Light Receiving Elements (AREA)
CN201980060777.8A 2018-08-16 2019-08-16 集成激光雷达图像传感器设备和系统以及相关的操作方法 Pending CN112771410A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862764895P 2018-08-16 2018-08-16
US62/764,895 2018-08-16
PCT/US2019/046806 WO2020037197A1 (en) 2018-08-16 2019-08-16 Integrated lidar image-sensor devices and systems and related methods of operation

Publications (1)

Publication Number Publication Date
CN112771410A true CN112771410A (zh) 2021-05-07

Family

ID=69523904

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980060777.8A Pending CN112771410A (zh) 2018-08-16 2019-08-16 集成激光雷达图像传感器设备和系统以及相关的操作方法

Country Status (6)

Country Link
US (2) US11598857B2 (de)
EP (1) EP3814803A4 (de)
JP (1) JP2021534412A (de)
KR (1) KR20210033540A (de)
CN (1) CN112771410A (de)
WO (1) WO2020037197A1 (de)

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11978754B2 (en) 2018-02-13 2024-05-07 Sense Photonics, Inc. High quantum efficiency Geiger-mode avalanche diodes including high sensitivity photon mixing structures and arrays thereof
US11467286B2 (en) * 2018-02-13 2022-10-11 Sense Photonics, Inc. Methods and systems for high-resolution long-range flash lidar
US10739462B2 (en) * 2018-05-25 2020-08-11 Lyft, Inc. Image sensor processing using a combined image and range measurement system
EP3920242A4 (de) * 2019-02-01 2022-04-13 Sony Semiconductor Solutions Corporation Lichtempfangselement, festkörperbildgebungsvorrichtung und entfernungsmessvorrichtung
US11294058B2 (en) 2019-04-08 2022-04-05 Sense Photonics, Inc. Motion correction based on phase vector components
JP7389578B2 (ja) * 2019-07-16 2023-11-30 シャープ株式会社 測距センサ
WO2021030034A1 (en) 2019-08-15 2021-02-18 Apple Inc. Depth mapping using spatial multiplexing of illumination phase
US11330246B2 (en) * 2019-11-21 2022-05-10 Microsoft Technology Licensing, Llc Imaging system configured to use time-of-flight imaging and stereo imaging
US20210156881A1 (en) * 2019-11-26 2021-05-27 Faro Technologies, Inc. Dynamic machine vision sensor (dmvs) that performs integrated 3d tracking
EP4078218A1 (de) * 2019-12-20 2022-10-26 AMS Sensors Asia Pte. Ltd. Lidar mit mehrbereichskanälen
US11763472B1 (en) 2020-04-02 2023-09-19 Apple Inc. Depth mapping with MPI mitigation using reference illumination pattern
US11269075B2 (en) 2020-04-17 2022-03-08 Samsung Electronics Co., Ltd. Hybrid sensor system and method for providing 3D imaging
US20210381960A1 (en) * 2020-06-08 2021-12-09 Artilux, Inc. Wideband Sensing Apparatus and Method Thereof
US11428792B2 (en) * 2020-06-08 2022-08-30 Stmicroelectronics (Research & Development) Limited Routing for DTOF sensors
WO2021252153A1 (en) 2020-06-11 2021-12-16 Apple Inc. Global-shutter image sensor with time-of-flight sensing capability
US11201993B1 (en) * 2020-06-15 2021-12-14 Samsung Electronics Co., Ltd. Multi-camera on a chip and camera module design
US20220011438A1 (en) * 2020-07-10 2022-01-13 Xin Jin Multi-domain optical sensor chip and apparatus
US11163064B1 (en) * 2020-07-13 2021-11-02 Palo Alto Research Center Incorporated Doppler imager
US20230408694A1 (en) * 2020-10-22 2023-12-21 Sense Photonics, Inc. Segmented flash lidar using stationary reflectors
US11721031B2 (en) * 2020-10-28 2023-08-08 Stmicroelectronics (Research & Development) Limited Scalable depth sensor
CN114646943A (zh) * 2020-12-17 2022-06-21 上海禾赛科技有限公司 接收装置、包括其的激光雷达及探测方法
CN115113220A (zh) * 2021-03-18 2022-09-27 华为技术有限公司 一种探测装置及终端设备
US20220299646A1 (en) * 2021-03-19 2022-09-22 Taiwan Semiconductor Manufacturing Company, Ltd. Pixel array including time-of-flight sensors
WO2023277998A2 (en) * 2021-04-26 2023-01-05 Neural Propulsion Systems, Inc. Moving aperture lidar
JP2022168742A (ja) * 2021-04-26 2022-11-08 キヤノン株式会社 測距装置
WO2023186581A1 (en) * 2022-03-29 2023-10-05 Sony Group Corporation Arrangement for depth sensing, device, methods and computer program

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020084430A1 (en) * 2000-11-09 2002-07-04 Canesta, Inc. Methods for CMOS-compatible three-dimensional image sensing using quantum efficiency modulation
US20050285966A1 (en) * 2004-01-28 2005-12-29 Canesta, Inc. Single chip red, green, blue, distance (RGB-Z) sensor
CN101866056A (zh) * 2010-05-28 2010-10-20 中国科学院合肥物质科学研究院 基于led阵列共透镜tof深度测量的三维成像方法和系统
CN102445688A (zh) * 2010-08-20 2012-05-09 电装国际美国公司 组合的飞行时间和图像传感器系统
US20120268566A1 (en) * 2011-04-21 2012-10-25 Samsung Electronics Co., Ltd. Three-dimensional color image sensors having spaced-apart multi-pixel color regions therein
US20130234029A1 (en) * 2012-03-06 2013-09-12 Omnivision Technologies, Inc. Image sensor for two-dimensional and three-dimensional image capture
US20140300718A1 (en) * 2013-04-03 2014-10-09 Beat Krattiger Camera for acquiring optical properties and spatial structure properties
US20160161599A1 (en) * 2014-12-03 2016-06-09 Melexis Technologies Nv Semiconductor pixel unit for sensing near-infrared light, optionally simultaneously with visible light, and a semiconductor sensor comprising same
JP2016162946A (ja) * 2015-03-04 2016-09-05 Jsr株式会社 固体撮像装置
JP2016211881A (ja) * 2015-04-30 2016-12-15 株式会社デンソー 光飛行時間測定装置及び光学的測距装置
CN106471621A (zh) * 2014-12-22 2017-03-01 谷歌公司 堆叠半导体芯片rgbz传感器
CN106526573A (zh) * 2016-12-30 2017-03-22 北醒（北京）光子科技有限公司 一种固态多线测距装置及测距方法
US20180084238A1 (en) * 2016-09-21 2018-03-22 Stmicroelectronics (Grenoble 2) Sas Device having a 2d image sensor and depth sensor
CN108291969A (zh) * 2015-11-24 2018-07-17 微软技术许可有限责任公司 具有共享像素读出电路系统的成像传感器
CN108369274A (zh) * 2015-11-05 2018-08-03 路明亮科技有限公司 用于高分辨率深度映射的具有经改进扫描速度的激光雷达系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6483725B2 (ja) 2014-04-07 2019-03-13 サムスン エレクトロニクス カンパニー リミテッド 光学的イベントを感知する方法とそのための光学的イベントセンサ、及び距離測定モバイル装置
US9866816B2 (en) 2016-03-03 2018-01-09 4D Intellectual Properties, Llc Methods and apparatus for an active pulsed 4D camera for image acquisition and analysis
WO2018191489A1 (en) 2017-04-12 2018-10-18 Sense Photonics, Inc. Ultra-small vertical cavity surface emitting laser (vcsel) and arrays incorporating the same

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020084430A1 (en) * 2000-11-09 2002-07-04 Canesta, Inc. Methods for CMOS-compatible three-dimensional image sensing using quantum efficiency modulation
US20050285966A1 (en) * 2004-01-28 2005-12-29 Canesta, Inc. Single chip red, green, blue, distance (RGB-Z) sensor
CN101866056A (zh) * 2010-05-28 2010-10-20 中国科学院合肥物质科学研究院 基于led阵列共透镜tof深度测量的三维成像方法和系统
CN102445688A (zh) * 2010-08-20 2012-05-09 电装国际美国公司 组合的飞行时间和图像传感器系统
US20120268566A1 (en) * 2011-04-21 2012-10-25 Samsung Electronics Co., Ltd. Three-dimensional color image sensors having spaced-apart multi-pixel color regions therein
US20130234029A1 (en) * 2012-03-06 2013-09-12 Omnivision Technologies, Inc. Image sensor for two-dimensional and three-dimensional image capture
US20140300718A1 (en) * 2013-04-03 2014-10-09 Beat Krattiger Camera for acquiring optical properties and spatial structure properties
US20160161599A1 (en) * 2014-12-03 2016-06-09 Melexis Technologies Nv Semiconductor pixel unit for sensing near-infrared light, optionally simultaneously with visible light, and a semiconductor sensor comprising same
CN106471621A (zh) * 2014-12-22 2017-03-01 谷歌公司 堆叠半导体芯片rgbz传感器
JP2016162946A (ja) * 2015-03-04 2016-09-05 Jsr株式会社 固体撮像装置
JP2016211881A (ja) * 2015-04-30 2016-12-15 株式会社デンソー 光飛行時間測定装置及び光学的測距装置
CN108369274A (zh) * 2015-11-05 2018-08-03 路明亮科技有限公司 用于高分辨率深度映射的具有经改进扫描速度的激光雷达系统
CN108291969A (zh) * 2015-11-24 2018-07-17 微软技术许可有限责任公司 具有共享像素读出电路系统的成像传感器
US20180084238A1 (en) * 2016-09-21 2018-03-22 Stmicroelectronics (Grenoble 2) Sas Device having a 2d image sensor and depth sensor
CN106526573A (zh) * 2016-12-30 2017-03-22 北醒（北京）光子科技有限公司 一种固态多线测距装置及测距方法

Also Published As

Publication number Publication date
JP2021534412A (ja) 2021-12-09
KR20210033540A (ko) 2021-03-26
EP3814803A4 (de) 2022-03-02
WO2020037197A1 (en) 2020-02-20
US20200057151A1 (en) 2020-02-20
US20230194679A1 (en) 2023-06-22
US11598857B2 (en) 2023-03-07
EP3814803A1 (de) 2021-05-05

Similar Documents

Publication Publication Date Title
US11598857B2 (en) Integrated lidar image-sensor devices and systems and related methods of operation
US7626685B2 (en) Distance measuring sensors including vertical photogate and three-dimensional color image sensors including distance measuring sensors
US11076081B2 (en) Device for acquiring a 2D image and a depth image of a scene
US10908266B2 (en) Time of flight distance sensor
CN108291969B (zh) 具有共享像素读出电路系统的成像传感器
US20200191925A1 (en) Systems and methods for an apd array solid-state laser radar
WO2020033001A2 (en) Methods and systems for high-resolution long-range flash lidar
KR101648353B1 (ko) 거리 센서를 포함하는 이미지 센서
CN105991978B (zh) 具有深度检测像素的图像传感器和产生深度数据的方法
CN108566524B (zh) 像素单元、图像传感器芯片、成像系统、像素单元的形成方法以及深度信息测算方法
CN104081528A (zh) 多光谱传感器
US11531094B2 (en) Method and system to determine distance using time of flight measurement comprising a control circuitry identifying which row of photosensitive image region has the captured image illumination stripe
WO2019041257A1 (zh) 信号处理芯片、图像处理系统和距离测量系统
US20220208815A1 (en) Image sensing device
US11722792B2 (en) Image sensing device
EP4290591A1 (de) Flugzeitbildsensor mit quantenpunkt-fotodetektoren
US20240159883A1 (en) Sensor device, sensor module, imaging system and method to operate a sensor device
WO2022170476A1 (zh) 激光接收电路及其控制方法、测距装置、移动平台
US20220278163A1 (en) Image sensing device
KR20230055605A (ko) 이미지 센싱 장치
CN116454099A (zh) 一种深槽隔离的spad像素单元

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination