KR20170023110A - 다중뷰 스테레오 및 캘리브레이션된 프로젝터를 이용한 깊이 추정 - Google Patents

다중뷰 스테레오 및 캘리브레이션된 프로젝터를 이용한 깊이 추정 Download PDF

Info

Publication number
KR20170023110A
KR20170023110A KR1020177001724A KR20177001724A KR20170023110A KR 20170023110 A KR20170023110 A KR 20170023110A KR 1020177001724 A KR1020177001724 A KR 1020177001724A KR 20177001724 A KR20177001724 A KR 20177001724A KR 20170023110 A KR20170023110 A KR 20170023110A
Authority
KR
South Korea
Prior art keywords
dot
depth
image
data
projection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
KR1020177001724A
Other languages
English (en)
Korean (ko)
Inventor
아다르쉬 프라카쉬 머시 코우들
리차드 에스. 젤리스키
Original Assignee
마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 filed Critical 마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Publication of KR20170023110A publication Critical patent/KR20170023110A/ko
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/2513—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/2545—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with one projection direction and several detection directions, e.g. stereo
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • H04N13/0271—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Processing (AREA)
  • Projection Apparatus (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Image Analysis (AREA)
  • Measurement Of Optical Distance (AREA)
KR1020177001724A 2014-06-30 2015-06-25 다중뷰 스테레오 및 캘리브레이션된 프로젝터를 이용한 깊이 추정 Withdrawn KR20170023110A (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/319,641 US20150381972A1 (en) 2014-06-30 2014-06-30 Depth estimation using multi-view stereo and a calibrated projector
US14/319,641 2014-06-30
PCT/US2015/037564 WO2016003745A1 (en) 2014-06-30 2015-06-25 Depth estimation using multi-view stereo and a calibrated projector

Publications (1)

Publication Number Publication Date
KR20170023110A true KR20170023110A (ko) 2017-03-02

Family

ID=53719946

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020177001724A Withdrawn KR20170023110A (ko) 2014-06-30 2015-06-25 다중뷰 스테레오 및 캘리브레이션된 프로젝터를 이용한 깊이 추정

Country Status (10)

Country Link
US (1) US20150381972A1 (enExample)
EP (1) EP3161789A1 (enExample)
JP (1) JP2017528731A (enExample)
KR (1) KR20170023110A (enExample)
CN (1) CN106464851B (enExample)
AU (1) AU2015284556A1 (enExample)
CA (1) CA2949387A1 (enExample)
MX (1) MX2016016736A (enExample)
RU (1) RU2016150826A (enExample)
WO (1) WO2016003745A1 (enExample)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11615594B2 (en) 2021-01-21 2023-03-28 Samsung Electronics Co., Ltd. Systems and methods for reconstruction of dense depth maps
WO2023059119A1 (ko) * 2021-10-07 2023-04-13 삼성전자 주식회사 거리 센서를 포함하는 전자 장치 및 거리 측정 방법
US11688073B2 (en) 2020-04-14 2023-06-27 Samsung Electronics Co., Ltd. Method and system for depth map reconstruction

Families Citing this family (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2013305770A1 (en) 2012-08-21 2015-02-26 Pelican Imaging Corporation Systems and methods for parallax detection and correction in images captured using array cameras
US8866912B2 (en) 2013-03-10 2014-10-21 Pelican Imaging Corporation System and methods for calibration of an array camera using a single captured image
US20150381965A1 (en) * 2014-06-27 2015-12-31 Qualcomm Incorporated Systems and methods for depth map extraction using a hybrid algorithm
DE102014113389A1 (de) * 2014-09-17 2016-03-17 Pilz Gmbh & Co. Kg Verfahren und Vorrichtung zum Identifizieren von Strukturelementen eines projizierten Strukturmusters in Kamerabildern
CN113256730B (zh) * 2014-09-29 2023-09-05 快图有限公司 用于阵列相机的动态校准的系统和方法
US9948920B2 (en) 2015-02-27 2018-04-17 Qualcomm Incorporated Systems and methods for error correction in structured light
JP6484071B2 (ja) * 2015-03-10 2019-03-13 アルプスアルパイン株式会社 物体検出装置
JP6484072B2 (ja) * 2015-03-10 2019-03-13 アルプスアルパイン株式会社 物体検出装置
US10068338B2 (en) * 2015-03-12 2018-09-04 Qualcomm Incorporated Active sensing spatial resolution improvement through multiple receivers and code reuse
WO2016156149A1 (en) * 2015-03-31 2016-10-06 Sony Corporation Imaging system using structured light for depth recovery
US9779328B2 (en) * 2015-08-28 2017-10-03 Intel Corporation Range image generation
US9846943B2 (en) 2015-08-31 2017-12-19 Qualcomm Incorporated Code domain power control for structured light
US20170299379A1 (en) * 2016-04-15 2017-10-19 Lockheed Martin Corporation Precision Hand-Held Scanner
CN106773495B (zh) * 2016-12-14 2018-05-18 深圳奥比中光科技有限公司 多光源投影仪的自动调焦方法与系统
CN110235006A (zh) 2017-01-31 2019-09-13 因温特奥股份公司 具有用于监控悬吊构件的完整性的监控装置的电梯
US10620316B2 (en) * 2017-05-05 2020-04-14 Qualcomm Incorporated Systems and methods for generating a structured light depth map with a non-uniform codeword pattern
US20190072771A1 (en) * 2017-09-05 2019-03-07 Facebook Technologies, Llc Depth measurement using multiple pulsed structured light projectors
KR102468897B1 (ko) * 2017-10-16 2022-11-21 삼성전자주식회사 깊이 값을 추정하는 방법 및 장치
EP3729804A4 (en) * 2017-12-20 2021-11-10 LEIA Inc. MULTI-VIEW CROSS-RENDERING CAMERA, SYSTEM, AND PROCESS
CN110033481B (zh) * 2018-01-10 2024-07-02 北京三星通信技术研究有限公司 用于进行图像处理的方法和设备
US10475196B2 (en) * 2018-03-22 2019-11-12 Microsoft Technology Licensing, Llc Hybrid depth detection and movement detection
US10728518B2 (en) * 2018-03-22 2020-07-28 Microsoft Technology Licensing, Llc Movement detection in low light environments
US10944957B2 (en) * 2018-03-22 2021-03-09 Microsoft Technology Licensing, Llc Active stereo matching for depth applications
US10565720B2 (en) 2018-03-27 2020-02-18 Microsoft Technology Licensing, Llc External IR illuminator enabling improved head tracking and surface reconstruction for virtual reality
CN108876835A (zh) * 2018-03-28 2018-11-23 北京旷视科技有限公司 深度信息检测方法、装置和系统及存储介质
CN108632593B (zh) * 2018-05-31 2020-05-19 歌尔股份有限公司 彩色汇聚误差的修正方法、装置及设备
CN110650325A (zh) * 2018-06-27 2020-01-03 恩益禧视像设备贸易（深圳）有限公司 投影仪定位装置及其定位方法
CN108833884B (zh) * 2018-07-17 2020-04-03 Oppo广东移动通信有限公司 深度校准方法及装置、终端、可读存储介质及计算机设备
CN110766737B (zh) * 2018-07-26 2023-08-04 富士通株式会社 训练深度估计模型的方法和设备以及存储介质
CN109190484A (zh) * 2018-08-06 2019-01-11 北京旷视科技有限公司 图像处理方法、装置和图像处理设备
US10699430B2 (en) 2018-10-09 2020-06-30 Industrial Technology Research Institute Depth estimation apparatus, autonomous vehicle using the same, and depth estimation method thereof
FR3088510A1 (fr) * 2018-11-09 2020-05-15 Orange Synthese de vues
WO2020181065A1 (en) 2019-03-07 2020-09-10 Alibaba Group Holding Limited Method, apparatus, medium, terminal, and device for processing multi-angle free-perspective data
CN111696144B (zh) * 2019-03-11 2024-06-25 北京地平线机器人技术研发有限公司 深度信息确定方法、深度信息确定装置及电子设备
CN117496922A (zh) * 2019-08-23 2024-02-02 伊格尼斯创新公司 光学校正方法和光学校正系统
US12316819B1 (en) * 2019-09-24 2025-05-27 Apple Inc. Method and device for perspective correction using a smooth depth map
US11158108B2 (en) * 2019-12-04 2021-10-26 Microsoft Technology Licensing, Llc Systems and methods for providing a mixed-reality pass-through experience
CN113012091A (zh) * 2019-12-20 2021-06-22 中国科学院沈阳计算技术研究所有限公司 一种基于多维单目深度估计的叶轮质量检测方法及装置
JP7734690B2 (ja) * 2020-04-22 2025-09-05 トリナミクス ゲゼルシャフト ミット ベシュレンクテル ハフツング 物体深度測定用照射パターン
US11475641B2 (en) * 2020-07-21 2022-10-18 Microsoft Technology Licensing, Llc Computer vision cameras for IR light detection
JP7389729B2 (ja) 2020-09-10 2023-11-30 株式会社日立製作所 障害物検知装置、障害物検知システム及び障害物検知方法
US11676293B2 (en) 2020-11-25 2023-06-13 Meta Platforms Technologies, Llc Methods for depth sensing using candidate images selected based on an epipolar line
WO2022147487A1 (en) * 2021-01-02 2022-07-07 Dreamvu Inc. System and method for generating dewarped image using projection patterns captured from omni-directional stereo cameras
CN113822925B (zh) * 2021-08-01 2023-12-19 国网江苏省电力有限公司徐州供电分公司 一种异步双目相机的深度估计方法及系统
CN113642565B (zh) * 2021-10-15 2022-02-11 腾讯科技（深圳）有限公司 对象检测方法、装置、设备及计算机可读存储介质
US12106512B2 (en) * 2022-07-29 2024-10-01 Inuitive Ltd. Method and apparatus for structured light calibration
US20240153116A1 (en) * 2022-11-07 2024-05-09 Google Llc Depth Estimation Using a Single Near-Infrared Camera and Dot Illuminator
CN116753843B (zh) * 2023-05-19 2024-04-12 北京建筑大学 工程结构动态位移监测方法、装置、设备及存储介质

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4056154B2 (ja) * 1997-12-30 2008-03-05 三星電子株式会社 ２次元連続映像の３次元映像変換装置及び方法並びに３次元映像の後処理方法
TWI428568B (zh) * 2010-09-03 2014-03-01 Pixart Imaging Inc 測距方法、測距系統與其處理軟體
US20120056982A1 (en) * 2010-09-08 2012-03-08 Microsoft Corporation Depth camera based on structured light and stereo vision
CN102074020B (zh) * 2010-12-31 2012-08-15 浙江大学 对视频进行多体深度恢复和分割的方法
US20130095920A1 (en) * 2011-10-13 2013-04-18 Microsoft Corporation Generating free viewpoint video using stereo imaging
EP2845167A4 (en) * 2012-05-01 2016-01-13 Pelican Imaging Corp CAMERA MODULES WITH PATTERN FROM PI FILTER GROUPS
GB201208088D0 (en) * 2012-05-09 2012-06-20 Ncam Sollutions Ltd Ncam
DE202012102541U1 (de) * 2012-07-10 2013-10-18 Sick Ag 3D-Kamera
CN103702098B (zh) * 2013-12-09 2015-12-30 上海交通大学 一种时空域联合约束的三视点立体视频深度提取方法
CN103679739A (zh) * 2013-12-26 2014-03-26 清华大学 基于遮挡区域检测的虚拟视图生成方法

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11688073B2 (en) 2020-04-14 2023-06-27 Samsung Electronics Co., Ltd. Method and system for depth map reconstruction
US11615594B2 (en) 2021-01-21 2023-03-28 Samsung Electronics Co., Ltd. Systems and methods for reconstruction of dense depth maps
WO2023059119A1 (ko) * 2021-10-07 2023-04-13 삼성전자 주식회사 거리 센서를 포함하는 전자 장치 및 거리 측정 방법

Also Published As

Publication number Publication date
CA2949387A1 (en) 2016-01-07
RU2016150826A (ru) 2018-06-25
EP3161789A1 (en) 2017-05-03
CN106464851A (zh) 2017-02-22
CN106464851B (zh) 2018-10-12
RU2016150826A3 (enExample) 2019-02-27
WO2016003745A1 (en) 2016-01-07
JP2017528731A (ja) 2017-09-28
AU2015284556A1 (en) 2016-11-17
US20150381972A1 (en) 2015-12-31
MX2016016736A (es) 2017-04-27

Similar Documents

Publication Publication Date Title
KR20170023110A (ko) 다중뷰 스테레오 및 캘리브레이션된 프로젝터를 이용한 깊이 추정
US10540784B2 (en) Calibrating texture cameras using features extracted from depth images
KR102207768B1 (ko) 이동 패턴 프로젝터에 의한 초고해상도 깊이 맵
US10620316B2 (en) Systems and methods for generating a structured light depth map with a non-uniform codeword pattern
US10298905B2 (en) Method and apparatus for determining a depth map for an angle
US20120287247A1 (en) Methods and systems for capturing 3d surface geometry
TW201301202A (zh) 影像處理方法以及影像處理裝置
US8994722B2 (en) Method for enhancing depth images of scenes using trellis structures
JPWO2019107180A1 (ja) 符号化装置、符号化方法、復号装置、および復号方法
US9158994B2 (en) Apparatus and method for real-time capable disparity estimation for virtual view rendering suitable for multi-threaded execution
EP4260554B1 (en) Apparatus and method for processing a depth map
US20150145861A1 (en) Method and arrangement for model generation
CN110678905B (zh) 用于处理深度图的装置及方法
Ye et al. Computational multi-view imaging with Kinect
US20120206442A1 (en) Method for Generating Virtual Images of Scenes Using Trellis Structures
CN113132706A (zh) 基于逆向映射的可控位置虚拟视点生成方法及装置
CN102857772B (zh) 影像处理方法以及影像处理装置
KR102267442B1 (ko) 가변 시점에서 촬영된 카메라 왜곡 보정 방법 및 이를 이용한 블록 3차원 모델링 방법
US11195290B2 (en) Apparatus and method for encoding in structured depth camera system
Liao et al. Stereo matching and viewpoint synthesis FPGA implementation
Pelletier et al. Real-time free viewpoint video from a range sensor and color cameras

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20170119

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
PC1203 Withdrawal of no request for examination