KR102432765B1 - Tof 카메라 시스템 및 그 시스템과의 거리를 측정하는 방법 - Google Patents

Tof 카메라 시스템 및 그 시스템과의 거리를 측정하는 방법 Download PDF

Info

Publication number
KR102432765B1
KR102432765B1 KR1020177000302A KR20177000302A KR102432765B1 KR 102432765 B1 KR102432765 B1 KR 102432765B1 KR 1020177000302 A KR1020177000302 A KR 1020177000302A KR 20177000302 A KR20177000302 A KR 20177000302A KR 102432765 B1 KR102432765 B1 KR 102432765B1
Authority
KR
South Korea
Prior art keywords
scene
light
indirect
complex data
pixels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020177000302A
Other languages
English (en)
Korean (ko)
Other versions
KR20170041681A (ko
Inventor
데르 템펠 바르드 반
Original Assignee
소니 뎁쓰센싱 솔루션즈 에스에이/엔브이
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 소니 뎁쓰센싱 솔루션즈 에스에이/엔브이 filed Critical 소니 뎁쓰센싱 솔루션즈 에스에이/엔브이
Publication of KR20170041681A publication Critical patent/KR20170041681A/ko
Application granted granted Critical
Publication of KR102432765B1 publication Critical patent/KR102432765B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/491—Details of non-pulse systems
    • G01S7/4911—Transmitters
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/08—Systems determining position data of a target for measuring distance only
    • G01S17/10—Systems determining position data of a target for measuring distance only using transmission of interrupted, pulse-modulated waves
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G01S17/894—Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/483—Details of pulse systems
    • G01S7/486—Receivers
    • G01S7/487—Extracting wanted echo signals, e.g. pulse detection
    • G01S7/4876—Extracting wanted echo signals, e.g. pulse detection by removing unwanted signals
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/491—Details of non-pulse systems
    • G01S7/493—Extracting wanted echo signals
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02—Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06—Systems determining position data of a target
    • G01S17/46—Indirect determination of position data

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Electromagnetism (AREA)
  • Optical Radar Systems And Details Thereof (AREA)
  • Measurement Of Optical Distance (AREA)
KR1020177000302A 2014-06-11 2015-06-11 Tof 카메라 시스템 및 그 시스템과의 거리를 측정하는 방법 Active KR102432765B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP14171985.6 2014-06-11
EP14171985.6A EP2955544B1 (en) 2014-06-11 2014-06-11 A TOF camera system and a method for measuring a distance with the system
PCT/EP2015/063015 WO2015189311A1 (en) 2014-06-11 2015-06-11 A tof camera system and a method for measuring a distance with the system

Publications (2)

Publication Number Publication Date
KR20170041681A KR20170041681A (ko) 2017-04-17
KR102432765B1 true KR102432765B1 (ko) 2022-08-17

Family

ID=50927987

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020177000302A Active KR102432765B1 (ko) 2014-06-11 2015-06-11 Tof 카메라 시스템 및 그 시스템과의 거리를 측정하는 방법

Country Status (7)

Country Link
US (1) US10901090B2 (https=)
EP (1) EP2955544B1 (https=)
JP (2) JP2017517737A (https=)
KR (1) KR102432765B1 (https=)
CN (1) CN106662651B (https=)
BE (1) BE1022486B1 (https=)
WO (1) WO2015189311A1 (https=)

Families Citing this family (44)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170323429A1 (en) 2016-05-09 2017-11-09 John Peter Godbaz Multiple patterns in time-of-flight camera apparatus
US10928489B2 (en) * 2017-04-06 2021-02-23 Microsoft Technology Licensing, Llc Time of flight camera
US10598768B2 (en) * 2017-05-24 2020-03-24 Microsoft Technology Licensing, Llc Multipath mitigation for time of flight system
EP3460508B1 (en) * 2017-09-22 2026-04-15 ams AG Semiconductor body and method for a time-of-flight measurement
US10215856B1 (en) 2017-11-27 2019-02-26 Microsoft Technology Licensing, Llc Time of flight camera
US11662433B2 (en) * 2017-12-22 2023-05-30 Denso Corporation Distance measuring apparatus, recognizing apparatus, and distance measuring method
US10901087B2 (en) * 2018-01-15 2021-01-26 Microsoft Technology Licensing, Llc Time of flight camera
CN108259744B (zh) * 2018-01-24 2020-06-23 北京图森智途科技有限公司 图像采集控制方法及其装置、图像采集系统和tof相机
JP7253323B2 (ja) * 2018-02-14 2023-04-06 オムロン株式会社 ３次元計測システム及び３次元計測方法
JP6918210B2 (ja) 2018-03-29 2021-08-11 ヌヴォトンテクノロジージャパン株式会社 距離情報取得装置、マルチパス検出装置およびマルチパス検出方法
US11988780B2 (en) 2018-05-09 2024-05-21 Sony Semiconductor Solutions Corporation Imaging device and method
CN109459738A (zh) * 2018-06-06 2019-03-12 杭州艾芯智能科技有限公司 一种多台tof相机相互避免干扰的方法及系统
US11609313B2 (en) 2018-07-31 2023-03-21 Waymo Llc Hybrid time-of-flight and imager module
JP2020020681A (ja) 2018-08-01 2020-02-06 ソニーセミコンダクタソリューションズ株式会社 光源装置、イメージセンサ、センシングモジュール
KR102570059B1 (ko) * 2018-08-16 2023-08-23 엘지이노텍 주식회사 센싱 방법 및 장치
US11353588B2 (en) 2018-11-01 2022-06-07 Waymo Llc Time-of-flight sensor with structured light illuminator
US11029149B2 (en) 2019-01-30 2021-06-08 Microsoft Technology Licensing, Llc Multipath mitigation for time of flight system
JP7208052B2 (ja) * 2019-02-15 2023-01-18 株式会社豊田中央研究所 光学的測距装置
US11698441B2 (en) * 2019-03-22 2023-07-11 Viavi Solutions Inc. Time of flight-based three-dimensional sensing system
WO2020218283A1 (ja) * 2019-04-22 2020-10-29 株式会社小糸製作所 ＴｏＦカメラ、車両用灯具、自動車
US11070757B2 (en) 2019-05-02 2021-07-20 Guangzhou Tyrafos Semiconductor Technologies Co., Ltd Image sensor with distance sensing function and operating method thereof
TWI723743B (zh) * 2019-05-02 2021-04-01 大陸商廣州印芯半導體技術有限公司 應用飛時測距的多媒體系統及其操作方法
US11479849B2 (en) * 2019-06-03 2022-10-25 Taiwan Semiconductor Manufacturing Company, Ltd. Physical vapor deposition chamber with target surface morphology monitor
EP3757615A1 (en) * 2019-06-28 2020-12-30 Infineon Technologies AG Method for determining distance information of an object using a time of flight system and time of flight system
US11644571B2 (en) 2019-07-01 2023-05-09 Samsung Electronics Co., Ltd. Electronic apparatus and control method thereof
CN112213730B (zh) * 2019-07-10 2024-05-07 睿镞科技(北京)有限责任公司 三维测距方法和装置
CN110378946B (zh) 2019-07-11 2021-10-01 Oppo广东移动通信有限公司 深度图处理方法、装置以及电子设备
CN116520348B (zh) * 2019-11-20 2025-11-04 深圳市光鉴科技有限公司 基于调制光场的深度成像系统、方法、设备及介质
CN112824934B (zh) * 2019-11-20 2024-05-07 深圳市光鉴科技有限公司 基于调制光场的tof多径干扰去除方法、系统、设备及介质
CN111045030B (zh) * 2019-12-18 2022-09-13 奥比中光科技集团股份有限公司 一种深度测量装置和方法
KR20210084752A (ko) 2019-12-27 2021-07-08 삼성전자주식회사 광원 및 ToF 센서를 포함하는 전자 장치 및 라이다 시스템
US20210255327A1 (en) * 2020-02-17 2021-08-19 Mediatek Inc. Emission And Reception Of Patterned Light Waves For Range Sensing
US12386044B2 (en) 2020-08-06 2025-08-12 Samsung Electronics Co., Ltd. Time-of-flight sensor and method of measuring distance using the same
WO2022201848A1 (ja) * 2021-03-22 2022-09-29 ソニーグループ株式会社 情報処理装置、情報処理方法およびプログラム
CN117043547A (zh) * 2021-03-26 2023-11-10 高通股份有限公司 混合模式深度成像
EP4095561A1 (en) * 2021-05-27 2022-11-30 Leica Geosystems AG Reality capture device
RU2770153C1 (ru) * 2021-06-15 2022-04-14 Самсунг Электроникс Ко., Лтд. Способ корректировки ошибки измерения глубины tof-камеры
CN113665904B (zh) * 2021-09-07 2023-04-07 钟放鸿 基于tof技术的条盒香烟缺包检测方法
US11922606B2 (en) 2021-10-04 2024-03-05 Samsung Electronics Co., Ltd. Multipass interference correction and material recognition based on patterned illumination without frame rate loss
CN113945951B (zh) * 2021-10-21 2022-07-08 浙江大学 Tof深度解算中的多径干扰抑制方法、tof深度解算方法及装置
WO2023113700A1 (en) * 2021-12-17 2023-06-22 Ams Sensors Singapore Pte. Ltd. A method for generating a depth map
JP2023172742A (ja) * 2022-05-24 2023-12-06 Ｔｏｐｐａｎホールディングス株式会社 距離画像撮像装置、及び距離画像撮像方法
FR3136558B1 (fr) * 2022-06-14 2024-06-21 St Microelectronics Grenoble 2 Capteur temps de vol et procédé de mesure de distances
WO2025154706A1 (ja) * 2024-01-16 2025-07-24 ヌヴォトンテクノロジージャパン株式会社 点群データ処理装置、点群データ処理方法、及び、プログラム

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130088726A1 (en) * 2011-10-07 2013-04-11 Vivek K. Goyal Method and Apparatus to Determine Depth Information For A Scene of Interest
US20150253429A1 (en) * 2014-03-06 2015-09-10 University Of Waikato Time of flight camera system which resolves direct and multi-path radiation components
US20160178737A1 (en) * 2013-08-21 2016-06-23 Pmdtechnologies Gmbh Scattered light reference pixel

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040213463A1 (en) * 2003-04-22 2004-10-28 Morrison Rick Lee Multiplexed, spatially encoded illumination system for determining imaging and range estimation
US9002511B1 (en) * 2005-10-21 2015-04-07 Irobot Corporation Methods and systems for obstacle detection using structured light
JP2008309551A (ja) 2007-06-13 2008-12-25 Nikon Corp 形状測定方法、記憶媒体、および形状測定装置
US20100157280A1 (en) * 2008-12-19 2010-06-24 Ambercore Software Inc. Method and system for aligning a line scan camera with a lidar scanner for real time data fusion in three dimensions
US8610808B2 (en) * 2008-12-22 2013-12-17 Koninklijke Philips N.V. Color CMOS imager with single photon counting capability
US8491135B2 (en) * 2010-01-04 2013-07-23 Microvision, Inc. Interactive projection with gesture recognition
EP2395369A1 (en) 2010-06-09 2011-12-14 Thomson Licensing Time-of-flight imager.
US9753128B2 (en) 2010-07-23 2017-09-05 Heptagon Micro Optics Pte. Ltd. Multi-path compensation using multiple modulation frequencies in time of flight sensor
DE102011081561B4 (de) 2011-08-25 2024-06-13 pmdtechnologies ag Lichtlaufzeitkamerasystem mit Signalpfadüberwachung
JP2013078433A (ja) * 2011-10-03 2013-05-02 Panasonic Corp 監視装置、プログラム
US9329035B2 (en) * 2011-12-12 2016-05-03 Heptagon Micro Optics Pte. Ltd. Method to compensate for errors in time-of-flight range cameras caused by multiple reflections
EP2815251B1 (en) * 2012-02-15 2017-03-22 Heptagon Micro Optics Pte. Ltd. Time of flight camera with stripe illumination
US9472005B1 (en) * 2012-04-18 2016-10-18 Amazon Technologies, Inc. Projection and camera system for augmented reality environment
US9696427B2 (en) * 2012-08-14 2017-07-04 Microsoft Technology Licensing, Llc Wide angle depth detection
JP6071363B2 (ja) 2012-09-19 2017-02-01 キヤノン株式会社 距離計測装置及び方法
US9857166B2 (en) 2012-09-19 2018-01-02 Canon Kabushiki Kaisha Information processing apparatus and method for measuring a target object
US9069080B2 (en) * 2013-05-24 2015-06-30 Advanced Scientific Concepts, Inc. Automotive auxiliary ladar sensor
US20170323429A1 (en) * 2016-05-09 2017-11-09 John Peter Godbaz Multiple patterns in time-of-flight camera apparatus

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130088726A1 (en) * 2011-10-07 2013-04-11 Vivek K. Goyal Method and Apparatus to Determine Depth Information For A Scene of Interest
US20160178737A1 (en) * 2013-08-21 2016-06-23 Pmdtechnologies Gmbh Scattered light reference pixel
US20150253429A1 (en) * 2014-03-06 2015-09-10 University Of Waikato Time of flight camera system which resolves direct and multi-path radiation components

Also Published As

Publication number Publication date
US10901090B2 (en) 2021-01-26
BE1022486B1 (fr) 2016-05-03
WO2015189311A1 (en) 2015-12-17
JP2021039131A (ja) 2021-03-11
EP2955544A1 (en) 2015-12-16
JP7191921B2 (ja) 2022-12-19
EP2955544B1 (en) 2020-06-17
JP2017517737A (ja) 2017-06-29
US20170123067A1 (en) 2017-05-04
CN106662651B (zh) 2019-08-06
KR20170041681A (ko) 2017-04-17
CN106662651A (zh) 2017-05-10

Similar Documents

Publication Publication Date Title
KR102432765B1 (ko) Tof 카메라 시스템 및 그 시스템과의 거리를 측정하는 방법
CN110709722B (zh) 飞行时间摄像机
US11536804B2 (en) Glare mitigation in LIDAR applications
US9709387B2 (en) Image generation device for acquiring distances of objects present in image space
US20200309914A1 (en) Spatially self-similar patterned illumination for depth imaging
US9194953B2 (en) 3D time-of-light camera and method
US8150142B2 (en) Depth mapping using projected patterns
EP3911920A1 (en) Three-dimensional sensor including bandpass filter having multiple passbands
US10151837B2 (en) Optoelectronic sensor
US20130294089A1 (en) Pattern projection using micro-lenses
US20150319347A1 (en) Methods and apparatus for imaging in scattering environments
KR20220075283A (ko) ToF 모듈
CN109673159B (zh) 基于多结构化照明的3d传感技术
JP2014070936A (ja) 誤差画素検出装置、誤差画素検出方法、および誤差画素検出プログラム
US9992472B1 (en) Optoelectronic devices for collecting three-dimensional data
CN116209921A (zh) 用于飞行时间相机系统的动态扩展的方法和设备
CN112946602B (zh) 多路径误差补偿的方法和多路径误差补偿的间接飞行时间距离计算装置
JP7631849B2 (ja) ３次元計測装置、３次元計測方法、３次元計測プログラム
US20090115993A1 (en) Device and Method for Recording Distance Images
JP2020139821A (ja) 検査装置、検査システム及び検査方法
US20230224428A1 (en) Information processing device, composite video generation method, and program
KR20250119576A (ko) 광학 감지 시스템
CN121773308A (zh) 对包括一个或多个具有透明表面的对象的场景进行成像的成像系统

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20170105

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
N231 Notification of change of applicant
PN2301 Change of applicant

Patent event date: 20181207

Comment text: Notification of Change of Applicant

Patent event code: PN23011R01D

A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20200323

Comment text: Request for Examination of Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20211228

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20220509

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20220810

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20220811

End annual number: 3

Start annual number: 1

PG1601 Publication of registration