CN102346250B - 飞行时间成像器 - Google Patents
飞行时间成像器 Download PDFInfo
- Publication number
- CN102346250B CN102346250B CN201110153467.6A CN201110153467A CN102346250B CN 102346250 B CN102346250 B CN 102346250B CN 201110153467 A CN201110153467 A CN 201110153467A CN 102346250 B CN102346250 B CN 102346250B
- Authority
- CN
- China
- Prior art keywords
- depth
- sensor
- depth map
- time
- measurement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000012937 correction Methods 0.000 claims abstract description 37
- 238000005259 measurement Methods 0.000 claims abstract description 22
- 230000001934 delay Effects 0.000 claims abstract description 5
- 238000000034 method Methods 0.000 claims description 18
- 230000014509 gene expression Effects 0.000 claims 6
- 239000000284 extract Substances 0.000 claims 2
- 238000005286 illumination Methods 0.000 claims 1
- 230000001678 irradiating effect Effects 0.000 claims 1
- 238000003384 imaging method Methods 0.000 abstract description 2
- 238000012546 transfer Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 238000012935 Averaging Methods 0.000 description 3
- 230000005855 radiation Effects 0.000 description 3
- 230000002123 temporal effect Effects 0.000 description 3
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000007613 environmental effect Effects 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000032683 aging Effects 0.000 description 1
- 230000023077 detection of light stimulus Effects 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/497—Means for monitoring or calibrating
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/487—Extracting wanted echo signals, e.g. pulse detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
- G01S17/06—Systems determining position data of a target
- G01S17/08—Systems determining position data of a target for measuring distance only
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Electromagnetism (AREA)
- Optical Radar Systems And Details Thereof (AREA)
- Measurement Of Optical Distance (AREA)
- Radar Systems Or Details Thereof (AREA)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP10305613.1 | 2010-06-09 | ||
| EP10305613A EP2395369A1 (en) | 2010-06-09 | 2010-06-09 | Time-of-flight imager. |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102346250A CN102346250A (zh) | 2012-02-08 |
| CN102346250B true CN102346250B (zh) | 2015-07-08 |
Family
ID=43087053
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110153467.6A Expired - Fee Related CN102346250B (zh) | 2010-06-09 | 2011-06-09 | 飞行时间成像器 |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US9188663B2 (enExample) |
| EP (2) | EP2395369A1 (enExample) |
| JP (1) | JP2011257402A (enExample) |
| KR (1) | KR20110134842A (enExample) |
| CN (1) | CN102346250B (enExample) |
| TW (1) | TWI518350B (enExample) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109490904A (zh) * | 2018-11-15 | 2019-03-19 | 上海炬佑智能科技有限公司 | 飞行时间传感器及其检测方法 |
Families Citing this family (40)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013009099A2 (ko) * | 2011-07-12 | 2013-01-17 | 삼성전자 주식회사 | 블러 처리 장치 및 방법 |
| WO2013148308A1 (en) * | 2012-03-28 | 2013-10-03 | Intel Corporation | Systems, methods, and computer program products for low-latency warping of a depth map |
| CN102761768A (zh) * | 2012-06-28 | 2012-10-31 | 中兴通讯股份有限公司 | 一种实现立体成像的方法及装置 |
| TWI571827B (zh) * | 2012-11-13 | 2017-02-21 | 財團法人資訊工業策進會 | 決定3d物件影像在3d環境影像中深度的電子裝置及其方法 |
| RU2012154657A (ru) * | 2012-12-17 | 2014-06-27 | ЭлЭсАй Корпорейшн | Способы и устройство для объединения изображений с глубиной, генерированных с использованием разных способов формирования изображений с глубиной |
| KR102003496B1 (ko) | 2013-03-06 | 2019-10-01 | 삼성전자주식회사 | 이미지 센서 및 이미지 픽업 장치 |
| US9134114B2 (en) * | 2013-03-11 | 2015-09-15 | Texas Instruments Incorporated | Time of flight sensor binning |
| US10230934B2 (en) * | 2013-06-14 | 2019-03-12 | Microsoft Tehcnology Licensing, Llc | Depth map correction using lookup tables |
| US10318100B2 (en) | 2013-10-16 | 2019-06-11 | Atheer, Inc. | Method and apparatus for addressing obstruction in an interface |
| US9182490B2 (en) | 2013-11-27 | 2015-11-10 | Semiconductor Components Industries, Llc | Video and 3D time-of-flight image sensors |
| EP2955544B1 (en) * | 2014-06-11 | 2020-06-17 | Sony Depthsensing Solutions N.V. | A TOF camera system and a method for measuring a distance with the system |
| US9578311B2 (en) * | 2014-10-22 | 2017-02-21 | Microsoft Technology Licensing, Llc | Time of flight depth camera |
| JP6609980B2 (ja) * | 2015-04-30 | 2019-11-27 | 株式会社デンソー | 光飛行時間測定装置及び光学的測距装置 |
| CN108352393B (zh) | 2015-07-23 | 2022-09-16 | 光程研创股份有限公司 | 高效宽光谱传感器 |
| US10707260B2 (en) | 2015-08-04 | 2020-07-07 | Artilux, Inc. | Circuit for operating a multi-gate VIS/IR photodiode |
| US10861888B2 (en) | 2015-08-04 | 2020-12-08 | Artilux, Inc. | Silicon germanium imager with photodiode in trench |
| EP3370258B1 (en) | 2015-08-04 | 2020-03-25 | Artilux Inc. | Germanium-silicon light sensing apparatus |
| US10761599B2 (en) | 2015-08-04 | 2020-09-01 | Artilux, Inc. | Eye gesture tracking |
| CN115824395B (zh) | 2015-08-27 | 2023-08-15 | 光程研创股份有限公司 | 宽频谱光学传感器 |
| US10418407B2 (en) | 2015-11-06 | 2019-09-17 | Artilux, Inc. | High-speed light sensing apparatus III |
| US10254389B2 (en) | 2015-11-06 | 2019-04-09 | Artilux Corporation | High-speed light sensing apparatus |
| US10741598B2 (en) | 2015-11-06 | 2020-08-11 | Atrilux, Inc. | High-speed light sensing apparatus II |
| US10886309B2 (en) | 2015-11-06 | 2021-01-05 | Artilux, Inc. | High-speed light sensing apparatus II |
| US10739443B2 (en) | 2015-11-06 | 2020-08-11 | Artilux, Inc. | High-speed light sensing apparatus II |
| EP3381182B1 (en) * | 2015-11-26 | 2020-02-19 | Odos Imaging Ltd. | Imaging system, distance measuring device, method for operating the imaging system and the distance measuring device |
| JP6805504B2 (ja) * | 2016-01-13 | 2020-12-23 | 株式会社リコー | 距離測定装置、移動体装置及び距離測定方法 |
| US10596964B2 (en) | 2016-01-13 | 2020-03-24 | Ricoh Company, Ltd. | Distance measurement device, moveable device, and distance measuring method |
| CN109073754B (zh) * | 2016-04-19 | 2022-07-01 | 日立乐金光科技株式会社 | 距离图像生成装置和距离图像生成方法 |
| KR102313821B1 (ko) * | 2016-09-30 | 2021-10-18 | (주) 솔 | 유동 채널을 갖는 렌즈프리 cmos 광 어레이 센서 패키지 모듈의 유체흐름 특성 평가 방법 |
| IL308768A (en) * | 2017-12-13 | 2024-01-01 | Magic Leap Inc | A general shutter pixel circuit and method for computer vision applications |
| US11105928B2 (en) | 2018-02-23 | 2021-08-31 | Artilux, Inc. | Light-sensing apparatus and light-sensing method thereof |
| CN111868929B (zh) | 2018-02-23 | 2021-08-03 | 奥特逻科公司 | 光检测装置及其光检测方法 |
| JP7212062B2 (ja) | 2018-04-08 | 2023-01-24 | アーティラックス・インコーポレイテッド | 光検出装置 |
| TWI795562B (zh) | 2018-05-07 | 2023-03-11 | 美商光程研創股份有限公司 | 雪崩式之光電晶體 |
| US10969877B2 (en) | 2018-05-08 | 2021-04-06 | Artilux, Inc. | Display apparatus |
| US11092678B2 (en) * | 2018-06-21 | 2021-08-17 | Analog Devices, Inc. | Measuring and removing the corruption of time-of-flight depth images due to internal scattering |
| TWI828695B (zh) | 2018-07-27 | 2024-01-11 | 日商索尼半導體解決方案公司 | 受光裝置及測距裝置 |
| CN111090104B (zh) * | 2019-12-26 | 2022-11-11 | 维沃移动通信有限公司 | 成像处理方法和电子设备 |
| CN111885316B (zh) * | 2020-07-09 | 2022-07-29 | 深圳奥辰光电科技有限公司 | 一种图像传感器像素电路、图像传感器及深度相机 |
| TWI833561B (zh) * | 2020-12-26 | 2024-02-21 | 以色列商趣眼有限公司 | 感測器、校正焦平面陣列中飽和檢測結果的方法及檢測物體深度資訊的方法 |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5047777A (en) * | 1989-05-12 | 1991-09-10 | Dornier Luftfahrt Gmbh | Linear method of navigation |
| WO2005036372A2 (en) * | 2003-10-09 | 2005-04-21 | Honda Motor Co., Ltd. | Systems and methods for determining depth using shuttered light pulses |
| US8355565B1 (en) * | 2009-10-29 | 2013-01-15 | Hewlett-Packard Development Company, L.P. | Producing high quality depth maps |
Family Cites Families (37)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE3915631A1 (de) * | 1989-05-12 | 1990-11-15 | Dornier Luftfahrt | Navigationsverfahren |
| DE3939731A1 (de) * | 1989-12-01 | 1991-06-06 | Dornier Luftfahrt | Autonomes landesystem |
| JPH0658755A (ja) | 1992-04-20 | 1994-03-04 | Nec Corp | 距離画像取得装置 |
| JPH0921871A (ja) | 1995-07-06 | 1997-01-21 | Mitsubishi Heavy Ind Ltd | 半導体レーザ距離測定装置 |
| GB2307611B (en) * | 1995-11-01 | 2000-03-22 | British Gas Plc | Measurement arrangement |
| US5825483A (en) | 1995-12-19 | 1998-10-20 | Cognex Corporation | Multiple field of view calibration plate having a reqular array of features for use in semiconductor manufacturing |
| US5796363A (en) * | 1996-03-01 | 1998-08-18 | The Regents Of The University Of California | Automatic position calculating imaging radar with low-cost synthetic aperture sensor for imaging layered media |
| US5835054A (en) * | 1996-03-01 | 1998-11-10 | The Regents Of The University Of California | Ultra wideband ground penetrating radar imaging of heterogeneous solids |
| DE69922706T2 (de) * | 1999-09-08 | 2005-12-08 | 3Dv Systems Ltd. | 3d- bilderzeugungssystem |
| JP2001153624A (ja) | 1999-11-24 | 2001-06-08 | Asahi Optical Co Ltd | 3次元画像入力装置 |
| US7724925B2 (en) * | 1999-12-02 | 2010-05-25 | Thermal Wave Imaging, Inc. | System for generating thermographic images using thermographic signal reconstruction |
| JP2001275132A (ja) | 2000-03-28 | 2001-10-05 | Asahi Optical Co Ltd | 3次元画像検出装置と撮像素子駆動回路 |
| JP2002202122A (ja) | 2001-01-05 | 2002-07-19 | Olympus Optical Co Ltd | 2次元距離画像センサのキャリブレーション方法 |
| US7013442B2 (en) * | 2001-11-13 | 2006-03-14 | Roberto Suaya | Synthesis strategies based on the appropriate use of inductance effects |
| US6749570B2 (en) * | 2002-08-23 | 2004-06-15 | Acuson Corporation | Ultrasound method and apparatus for imaging breast |
| US7789286B2 (en) * | 2003-06-04 | 2010-09-07 | Chrysler Group Llc | Method and apparatus for assessing the quality of spot welds |
| GB2421383A (en) * | 2004-12-07 | 2006-06-21 | Instro Prec Ltd | Surface profile measurement |
| US7167124B2 (en) * | 2004-12-23 | 2007-01-23 | Sensors & Software Inc. | Data acquisition for a ground penetrating radar system |
| US20070000328A1 (en) * | 2005-01-06 | 2007-01-04 | Jonathan Buttram | Ultrasonic method for the accurate measurement of crack height in dissimilar metal welds using phased array |
| US7450220B2 (en) * | 2006-02-08 | 2008-11-11 | Canesta, Inc | Method and system to correct motion blur and reduce signal transients in time-of-flight sensor systems |
| JP4877766B2 (ja) * | 2006-08-25 | 2012-02-15 | 独立行政法人放射線医学総合研究所 | 陽電子放射断層撮像装置及び放射線検出器 |
| JP2008128792A (ja) | 2006-11-20 | 2008-06-05 | Fujifilm Corp | 距離画像作成装置及び方法 |
| WO2008084468A2 (en) * | 2007-01-14 | 2008-07-17 | Microsoft International Holdings B.V. | A method, device and system for imaging |
| US7792423B2 (en) | 2007-02-06 | 2010-09-07 | Mitsubishi Electric Research Laboratories, Inc. | 4D light field cameras |
| JP5109803B2 (ja) * | 2007-06-06 | 2012-12-26 | ソニー株式会社 | 画像処理装置、画像処理方法及び画像処理プログラム |
| EP2116864A1 (en) | 2008-05-09 | 2009-11-11 | Vrije Universiteit Brussel | TOF range finding with background radiation suppression |
| US9041915B2 (en) * | 2008-05-09 | 2015-05-26 | Ball Aerospace & Technologies Corp. | Systems and methods of scene and action capture using imaging system incorporating 3D LIDAR |
| US8456517B2 (en) * | 2008-07-09 | 2013-06-04 | Primesense Ltd. | Integrated processor for 3D mapping |
| EP2310798B1 (en) | 2008-07-29 | 2016-10-26 | Microsoft International Holdings B.V. | Imaging system |
| US8194995B2 (en) * | 2008-09-30 | 2012-06-05 | Sony Corporation | Fast camera auto-focus |
| US8203602B2 (en) * | 2009-02-06 | 2012-06-19 | Robert Bosch Gmbh | Depth-aware blur kernel estimation method for iris deblurring |
| US8374389B2 (en) * | 2009-02-06 | 2013-02-12 | Robert Bosch Gmbh | Iris deblurring method based on global and local iris image statistics |
| US9582889B2 (en) * | 2009-07-30 | 2017-02-28 | Apple Inc. | Depth mapping based on pattern matching and stereoscopic information |
| JP5526727B2 (ja) * | 2009-11-20 | 2014-06-18 | ソニー株式会社 | 画像処理装置、画像処理方法およびプログラム |
| US8638424B2 (en) * | 2010-01-19 | 2014-01-28 | Microsoft Corporation | Charge equalizing clock driver and other enhancements for time-of-flight depth sensing and other systems |
| US8428342B2 (en) * | 2010-08-12 | 2013-04-23 | At&T Intellectual Property I, L.P. | Apparatus and method for providing three dimensional media content |
| US9471988B2 (en) * | 2011-11-02 | 2016-10-18 | Google Inc. | Depth-map generation for an input image using an example approximate depth-map associated with an example similar image |
-
2010
- 2010-06-09 EP EP10305613A patent/EP2395369A1/en not_active Withdrawn
-
2011
- 2011-05-02 TW TW100115308A patent/TWI518350B/zh not_active IP Right Cessation
- 2011-05-19 EP EP11166760.6A patent/EP2395370B1/en not_active Not-in-force
- 2011-05-28 US US13/134,089 patent/US9188663B2/en not_active Expired - Fee Related
- 2011-06-08 KR KR1020110055032A patent/KR20110134842A/ko not_active Withdrawn
- 2011-06-09 JP JP2011129111A patent/JP2011257402A/ja active Pending
- 2011-06-09 CN CN201110153467.6A patent/CN102346250B/zh not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5047777A (en) * | 1989-05-12 | 1991-09-10 | Dornier Luftfahrt Gmbh | Linear method of navigation |
| WO2005036372A2 (en) * | 2003-10-09 | 2005-04-21 | Honda Motor Co., Ltd. | Systems and methods for determining depth using shuttered light pulses |
| US8355565B1 (en) * | 2009-10-29 | 2013-01-15 | Hewlett-Packard Development Company, L.P. | Producing high quality depth maps |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109490904A (zh) * | 2018-11-15 | 2019-03-19 | 上海炬佑智能科技有限公司 | 飞行时间传感器及其检测方法 |
| CN109490904B (zh) * | 2018-11-15 | 2021-09-21 | 上海炬佑智能科技有限公司 | 飞行时间传感器及其检测方法 |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2011257402A (ja) | 2011-12-22 |
| US20110304696A1 (en) | 2011-12-15 |
| TWI518350B (zh) | 2016-01-21 |
| EP2395370B1 (en) | 2014-05-07 |
| CN102346250A (zh) | 2012-02-08 |
| TW201144848A (en) | 2011-12-16 |
| EP2395369A1 (en) | 2011-12-14 |
| KR20110134842A (ko) | 2011-12-15 |
| US9188663B2 (en) | 2015-11-17 |
| EP2395370A1 (en) | 2011-12-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102346250B (zh) | 飞行时间成像器 | |
| JP6676866B2 (ja) | 測距撮像装置及び固体撮像素子 | |
| US10430956B2 (en) | Time-of-flight (TOF) capturing apparatus and image processing method of reducing distortion of depth caused by multiple reflection | |
| US8339582B2 (en) | Apparatus and method to correct image | |
| US10422859B2 (en) | Distance measuring device and solid-state image sensor | |
| JP5295511B2 (ja) | 測距装置及び測距方法 | |
| KR101697519B1 (ko) | 깊이 센싱 장치 및 방법 | |
| EP3334152B1 (en) | Solid-state imaging device | |
| JP2011257402A5 (enExample) | ||
| CN110868582B (zh) | 具有校正功能的图像获取系统 | |
| CN108700650B (zh) | 用于校准光传播时间摄像机的装置和方法 | |
| US20140118556A1 (en) | Detection system | |
| CN112740065B (zh) | 成像装置、用于成像的方法和用于深度映射的方法 | |
| JP6413595B2 (ja) | 画像処理装置、システム、画像処理方法およびプログラム | |
| WO2021189794A1 (zh) | 飞行时间测距系统及其测距方法 | |
| JPWO2016133053A1 (ja) | 距離画像計測装置 | |
| JP2017198477A (ja) | 距離画像生成装置 | |
| CN111352120B (zh) | 飞行时间测距系统及其测距方法 | |
| CN102401647B (zh) | 光学测距系统 | |
| US20220364849A1 (en) | Multi-sensor depth mapping | |
| Li et al. | Measurement linearity and accuracy optimization for time-of-flight range imaging cameras | |
| JP2012173243A (ja) | 3次元計測装置、および3次元計測方法 | |
| CN112213711B (zh) | 一种tof相机的校准方法 | |
| TWI435059B (zh) | 光學測距系統 | |
| CN113900113B (zh) | Tof传感装置及其距离检测方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20190530 Address after: Paris France Patentee after: Interactive Digital CE Patent Holding Company Address before: I Si Eli Murli Nor, France Patentee before: Thomson Licensing Corp. |
|
| TR01 | Transfer of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150708 Termination date: 20210609 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |