CN106464851B - 使用多视点立体图和经校准的投射器的深度估计 - Google Patents

使用多视点立体图和经校准的投射器的深度估计 Download PDF

Info

Publication number
CN106464851B
CN106464851B CN201580033397.7A CN201580033397A CN106464851B CN 106464851 B CN106464851 B CN 106464851B CN 201580033397 A CN201580033397 A CN 201580033397A CN 106464851 B CN106464851 B CN 106464851B
Authority
CN
China
Prior art keywords
point
depth
location
data
pixel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201580033397.7A
Other languages
English (en)
Chinese (zh)
Other versions
CN106464851A (zh
Inventor
A·P·M·考德尔
R·S·斯泽利斯基
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Publication of CN106464851A publication Critical patent/CN106464851A/zh
Application granted granted Critical
Publication of CN106464851B publication Critical patent/CN106464851B/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • H04N9/3194—Testing thereof including sensor feedback
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/2513—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with several lines being projected in more than one direction, e.g. grids, patterns
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G01B11/2545—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object with one projection direction and several detection directions, e.g. stereo
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/55—Depth or shape recovery from multiple images
    • G06T7/593—Depth or shape recovery from multiple images from stereo images
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00—Details of colour television systems
    • H04N9/12—Picture reproducers
    • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3191—Testing thereof
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10048—Infrared image

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Processing (AREA)
  • Projection Apparatus (AREA)
  • Transforming Electric Information Into Light Information (AREA)
  • Measurement Of Optical Distance (AREA)
  • Image Analysis (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Controls And Circuits For Display Device (AREA)
CN201580033397.7A 2014-06-30 2015-06-25 使用多视点立体图和经校准的投射器的深度估计 Expired - Fee Related CN106464851B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US14/319,641 US20150381972A1 (en) 2014-06-30 2014-06-30 Depth estimation using multi-view stereo and a calibrated projector
US14/319,641 2014-06-30
PCT/US2015/037564 WO2016003745A1 (en) 2014-06-30 2015-06-25 Depth estimation using multi-view stereo and a calibrated projector

Publications (2)

Publication Number Publication Date
CN106464851A CN106464851A (zh) 2017-02-22
CN106464851B true CN106464851B (zh) 2018-10-12

Family

ID=53719946

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580033397.7A Expired - Fee Related CN106464851B (zh) 2014-06-30 2015-06-25 使用多视点立体图和经校准的投射器的深度估计

Country Status (10)

Country Link
US (1) US20150381972A1 (enExample)
EP (1) EP3161789A1 (enExample)
JP (1) JP2017528731A (enExample)
KR (1) KR20170023110A (enExample)
CN (1) CN106464851B (enExample)
AU (1) AU2015284556A1 (enExample)
CA (1) CA2949387A1 (enExample)
MX (1) MX2016016736A (enExample)
RU (1) RU2016150826A (enExample)
WO (1) WO2016003745A1 (enExample)

Families Citing this family (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8866920B2 (en) 2008-05-20 2014-10-21 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
FI4296963T3 (fi) 2012-08-21 2025-03-31 Adeia Imaging Llc Menetelmä syvyyden tunnistamiseksi kameraryhmällä otetuista kuvista
US8866912B2 (en) 2013-03-10 2014-10-21 Pelican Imaging Corporation System and methods for calibration of an array camera using a single captured image
US20150381965A1 (en) * 2014-06-27 2015-12-31 Qualcomm Incorporated Systems and methods for depth map extraction using a hybrid algorithm
DE102014113389A1 (de) * 2014-09-17 2016-03-17 Pilz Gmbh & Co. Kg Verfahren und Vorrichtung zum Identifizieren von Strukturelementen eines projizierten Strukturmusters in Kamerabildern
JP2017531976A (ja) * 2014-09-29 2017-10-26 フォトネイション ケイマン リミテッド アレイカメラを動的に較正するためのシステム及び方法
US9948920B2 (en) 2015-02-27 2018-04-17 Qualcomm Incorporated Systems and methods for error correction in structured light
JP6484072B2 (ja) * 2015-03-10 2019-03-13 アルプスアルパイン株式会社 物体検出装置
JP6484071B2 (ja) * 2015-03-10 2019-03-13 アルプスアルパイン株式会社 物体検出装置
US10068338B2 (en) * 2015-03-12 2018-09-04 Qualcomm Incorporated Active sensing spatial resolution improvement through multiple receivers and code reuse
US10410366B2 (en) * 2015-03-31 2019-09-10 Sony Corporation Imaging system using structured light for depth recovery
US9779328B2 (en) * 2015-08-28 2017-10-03 Intel Corporation Range image generation
US9846943B2 (en) 2015-08-31 2017-12-19 Qualcomm Incorporated Code domain power control for structured light
US20170299379A1 (en) * 2016-04-15 2017-10-19 Lockheed Martin Corporation Precision Hand-Held Scanner
CN106773495B (zh) * 2016-12-14 2018-05-18 深圳奥比中光科技有限公司 多光源投影仪的自动调焦方法与系统
US11945691B2 (en) 2017-01-31 2024-04-02 Inventio Ag Elevator with a monitoring arrangement for monitoring an integrity of suspension members
US10620316B2 (en) * 2017-05-05 2020-04-14 Qualcomm Incorporated Systems and methods for generating a structured light depth map with a non-uniform codeword pattern
US20190072771A1 (en) * 2017-09-05 2019-03-07 Facebook Technologies, Llc Depth measurement using multiple pulsed structured light projectors
KR102468897B1 (ko) * 2017-10-16 2022-11-21 삼성전자주식회사 깊이 값을 추정하는 방법 및 장치
EP3729804A4 (en) * 2017-12-20 2021-11-10 LEIA Inc. MULTI-VIEW CROSS-RENDERING CAMERA, SYSTEM, AND PROCESS
CN110033481B (zh) * 2018-01-10 2024-07-02 北京三星通信技术研究有限公司 用于进行图像处理的方法和设备
US10944957B2 (en) * 2018-03-22 2021-03-09 Microsoft Technology Licensing, Llc Active stereo matching for depth applications
US10475196B2 (en) * 2018-03-22 2019-11-12 Microsoft Technology Licensing, Llc Hybrid depth detection and movement detection
US10728518B2 (en) * 2018-03-22 2020-07-28 Microsoft Technology Licensing, Llc Movement detection in low light environments
US10565720B2 (en) 2018-03-27 2020-02-18 Microsoft Technology Licensing, Llc External IR illuminator enabling improved head tracking and surface reconstruction for virtual reality
CN108876835A (zh) * 2018-03-28 2018-11-23 北京旷视科技有限公司 深度信息检测方法、装置和系统及存储介质
CN108632593B (zh) * 2018-05-31 2020-05-19 歌尔股份有限公司 彩色汇聚误差的修正方法、装置及设备
CN110650325A (zh) * 2018-06-27 2020-01-03 恩益禧视像设备贸易（深圳）有限公司 投影仪定位装置及其定位方法
CN108833884B (zh) * 2018-07-17 2020-04-03 Oppo广东移动通信有限公司 深度校准方法及装置、终端、可读存储介质及计算机设备
CN110766737B (zh) * 2018-07-26 2023-08-04 富士通株式会社 训练深度估计模型的方法和设备以及存储介质
CN109190484A (zh) * 2018-08-06 2019-01-11 北京旷视科技有限公司 图像处理方法、装置和图像处理设备
US10699430B2 (en) 2018-10-09 2020-06-30 Industrial Technology Research Institute Depth estimation apparatus, autonomous vehicle using the same, and depth estimation method thereof
FR3088510A1 (fr) * 2018-11-09 2020-05-15 Orange Synthese de vues
US11521347B2 (en) 2019-03-07 2022-12-06 Alibaba Group Holding Limited Method, apparatus, medium, and device for generating multi-angle free-respective image data
CN111696144B (zh) * 2019-03-11 2024-06-25 北京地平线机器人技术研发有限公司 深度信息确定方法、深度信息确定装置及电子设备
US11637973B2 (en) * 2019-08-23 2023-04-25 Ignis Innovation Inc. Pixel location calibration image capture and processing
US12316819B1 (en) * 2019-09-24 2025-05-27 Apple Inc. Method and device for perspective correction using a smooth depth map
US11158108B2 (en) * 2019-12-04 2021-10-26 Microsoft Technology Licensing, Llc Systems and methods for providing a mixed-reality pass-through experience
CN113012091A (zh) * 2019-12-20 2021-06-22 中国科学院沈阳计算技术研究所有限公司 一种基于多维单目深度估计的叶轮质量检测方法及装置
US11688073B2 (en) 2020-04-14 2023-06-27 Samsung Electronics Co., Ltd. Method and system for depth map reconstruction
WO2021214123A1 (en) * 2020-04-22 2021-10-28 Trinamix Gmbh Illumination pattern for object depth measurment
US11475641B2 (en) * 2020-07-21 2022-10-18 Microsoft Technology Licensing, Llc Computer vision cameras for IR light detection
JP7389729B2 (ja) 2020-09-10 2023-11-30 株式会社日立製作所 障害物検知装置、障害物検知システム及び障害物検知方法
EP4217963A1 (en) * 2020-09-23 2023-08-02 QUALCOMM Incorporated Decoding an image for active depth sensing to account for optical distortions
US11676293B2 (en) * 2020-11-25 2023-06-13 Meta Platforms Technologies, Llc Methods for depth sensing using candidate images selected based on an epipolar line
US11677921B2 (en) * 2021-01-02 2023-06-13 Dreamvu Inc. System and method for generating dewarped image using projection patterns captured from omni-directional stereo cameras
US11615594B2 (en) 2021-01-21 2023-03-28 Samsung Electronics Co., Ltd. Systems and methods for reconstruction of dense depth maps
CN113822925B (zh) * 2021-08-01 2023-12-19 国网江苏省电力有限公司徐州供电分公司 一种异步双目相机的深度估计方法及系统
KR20230049902A (ko) * 2021-10-07 2023-04-14 삼성전자주식회사 거리 센서를 포함하는 전자 장치 및 거리 측정 방법
CN113642565B (zh) * 2021-10-15 2022-02-11 腾讯科技（深圳）有限公司 对象检测方法、装置、设备及计算机可读存储介质
US12106512B2 (en) * 2022-07-29 2024-10-01 Inuitive Ltd. Method and apparatus for structured light calibration
US12573066B2 (en) * 2022-11-07 2026-03-10 Google Llc Depth estimation using a single near-infrared camera and dot illuminator
CN116753843B (zh) * 2023-05-19 2024-04-12 北京建筑大学 工程结构动态位移监测方法、装置、设备及存储介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102074020A (zh) * 2010-12-31 2011-05-25 浙江大学 对视频进行多体深度恢复和分割的方法
CN102385237A (zh) * 2010-09-08 2012-03-21 微软公司 基于结构化光和立体视觉的深度相机
CN102938844A (zh) * 2011-10-13 2013-02-20 微软公司 利用立体成像生成自由视点视频
DE202012102541U1 (de) * 2012-07-10 2013-10-18 Sick Ag 3D-Kamera
WO2013166215A1 (en) * 2012-05-01 2013-11-07 Pelican Imaging Corporation CAMERA MODULES PATTERNED WITH pi FILTER GROUPS
WO2013167901A1 (en) * 2012-05-09 2013-11-14 Ncam Technologies Limited A system for mixing or compositing in real-time, computer generated 3d objects and a video feed from a film camera
CN103679739A (zh) * 2013-12-26 2014-03-26 清华大学 基于遮挡区域检测的虚拟视图生成方法
CN103702098A (zh) * 2013-12-09 2014-04-02 上海交通大学 一种时空域联合约束的三视点立体视频深度提取方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4056154B2 (ja) * 1997-12-30 2008-03-05 三星電子株式会社 ２次元連続映像の３次元映像変換装置及び方法並びに３次元映像の後処理方法
TWI428568B (zh) * 2010-09-03 2014-03-01 Pixart Imaging Inc 測距方法、測距系統與其處理軟體

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102385237A (zh) * 2010-09-08 2012-03-21 微软公司 基于结构化光和立体视觉的深度相机
CN102074020A (zh) * 2010-12-31 2011-05-25 浙江大学 对视频进行多体深度恢复和分割的方法
CN102938844A (zh) * 2011-10-13 2013-02-20 微软公司 利用立体成像生成自由视点视频
WO2013166215A1 (en) * 2012-05-01 2013-11-07 Pelican Imaging Corporation CAMERA MODULES PATTERNED WITH pi FILTER GROUPS
WO2013167901A1 (en) * 2012-05-09 2013-11-14 Ncam Technologies Limited A system for mixing or compositing in real-time, computer generated 3d objects and a video feed from a film camera
DE202012102541U1 (de) * 2012-07-10 2013-10-18 Sick Ag 3D-Kamera
CN103702098A (zh) * 2013-12-09 2014-04-02 上海交通大学 一种时空域联合约束的三视点立体视频深度提取方法
CN103679739A (zh) * 2013-12-26 2014-03-26 清华大学 基于遮挡区域检测的虚拟视图生成方法

Also Published As

Publication number Publication date
CN106464851A (zh) 2017-02-22
AU2015284556A1 (en) 2016-11-17
RU2016150826A (ru) 2018-06-25
US20150381972A1 (en) 2015-12-31
MX2016016736A (es) 2017-04-27
CA2949387A1 (en) 2016-01-07
WO2016003745A1 (en) 2016-01-07
JP2017528731A (ja) 2017-09-28
KR20170023110A (ko) 2017-03-02
RU2016150826A3 (enExample) 2019-02-27
EP3161789A1 (en) 2017-05-03

Similar Documents

Publication Publication Date Title
CN106464851B (zh) 使用多视点立体图和经校准的投射器的深度估计
US10540784B2 (en) Calibrating texture cameras using features extracted from depth images
JP5442111B2 (ja) 画像から高速に立体構築を行なう方法
US8447099B2 (en) Forming 3D models using two images
US20120242795A1 (en) Digital 3d camera using periodic illumination
TWI493505B (zh) 影像處理方法以及影像處理裝置
US20120177284A1 (en) Forming 3d models using multiple images
EP3311361B1 (en) Method and apparatus for determining a depth map for an image
US10547822B2 (en) Image processing apparatus and method to generate high-definition viewpoint interpolation image
US20120176380A1 (en) Forming 3d models using periodic illumination patterns
WO2012096747A1 (en) Forming range maps using periodic illumination patterns
CN102385708A (zh) 用于检测差异的方法和设备
CN105143817A (zh) 通过移动图案投影仪对深度图进行超解析
US9214025B2 (en) Depth estimation using normalized displacement of image pairs
US20180321384A1 (en) Systems and methods for generating a structured light depth map with a non-uniform codeword pattern
JP2009139995A (ja) ステレオ画像対における画素のリアルタイムマッチングのための装置及びプログラム
CN107346040A (zh) 裸眼3d显示设备的光栅参数的确定方法、装置及电子设备
CN116433848A (zh) 屏幕模型生成方法、装置、电子设备和存储介质
JP3988879B2 (ja) 立体画像生成方法及び立体画像生成装置、ならびに立体画像生成プログラム及び記録媒体
US20150145861A1 (en) Method and arrangement for model generation
CN113132706A (zh) 基于逆向映射的可控位置虚拟视点生成方法及装置
CN102857772A (zh) 影像处理方法以及影像处理装置
KR20220071935A (ko) 광학 흐름을 이용한 고해상도 깊이 영상 추정 방법 및 장치
JP2012073930A (ja) 画像処理装置、画像処理方法及びプログラム
Pelletier et al. Real-time free viewpoint video from a range sensor and color cameras

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20181012

Termination date: 20190625

CF01 Termination of patent right due to non-payment of annual fee