CN107408204A - 使用图案化光提供深度图的方法和系统 - Google Patents
使用图案化光提供深度图的方法和系统 Download PDFInfo
- Publication number
- CN107408204A CN107408204A CN201680013804.2A CN201680013804A CN107408204A CN 107408204 A CN107408204 A CN 107408204A CN 201680013804 A CN201680013804 A CN 201680013804A CN 107408204 A CN107408204 A CN 107408204A
- Authority
- CN
- China
- Prior art keywords
- depth map
- edges
- axis
- geometric features
- edge
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 21
- 238000004458 analytical method Methods 0.000 claims abstract description 12
- 238000013213 extrapolation Methods 0.000 claims 1
- 238000001514 detection method Methods 0.000 abstract 1
- 238000000059 patterning Methods 0.000 abstract 1
- 210000003811 finger Anatomy 0.000 description 24
- 238000010586 diagram Methods 0.000 description 10
- 230000000694 effects Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 5
- 230000011218 segmentation Effects 0.000 description 4
- 210000003813 thumb Anatomy 0.000 description 4
- 238000003709 image segmentation Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 241000272525 Anas platyrhynchos Species 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/77—Retouching; Inpainting; Scratch removal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/12—Edge-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/64—Three-dimensional objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/12—Acquisition of 3D measurements of objects
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Optics & Photonics (AREA)
- Human Computer Interaction (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims (6)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562100340P | 2015-01-06 | 2015-01-06 | |
US62/100,340 | 2015-01-06 | ||
PCT/US2016/012197 WO2016112019A1 (en) | 2015-01-06 | 2016-01-05 | Method and system for providing depth mapping using patterned light |
Publications (2)
Publication Number | Publication Date |
---|---|
CN107408204A true CN107408204A (zh) | 2017-11-28 |
CN107408204B CN107408204B (zh) | 2021-03-09 |
Family
ID=56286778
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201680013804.2A Expired - Fee Related CN107408204B (zh) | 2015-01-06 | 2016-01-05 | 使用图案化光提供深度图的方法和系统 |
Country Status (6)
Country | Link |
---|---|
US (1) | US20160196657A1 (zh) |
EP (1) | EP3243188A4 (zh) |
JP (1) | JP6782239B2 (zh) |
KR (1) | KR20170104506A (zh) |
CN (1) | CN107408204B (zh) |
WO (1) | WO2016112019A1 (zh) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2011036618A2 (en) * | 2009-09-22 | 2011-03-31 | Pebblestech Ltd. | Remote control of computer devices |
US9842392B2 (en) * | 2014-12-15 | 2017-12-12 | Koninklijke Philips N.V. | Device, system and method for skin detection |
US10116915B2 (en) * | 2017-01-17 | 2018-10-30 | Seiko Epson Corporation | Cleaning of depth data by elimination of artifacts caused by shadows and parallax |
US10620316B2 (en) * | 2017-05-05 | 2020-04-14 | Qualcomm Incorporated | Systems and methods for generating a structured light depth map with a non-uniform codeword pattern |
US10535151B2 (en) | 2017-08-22 | 2020-01-14 | Microsoft Technology Licensing, Llc | Depth map with structured and flood light |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101542529A (zh) * | 2006-11-21 | 2009-09-23 | 皇家飞利浦电子股份有限公司 | 图像的深度图的生成 |
CN102203829A (zh) * | 2008-11-04 | 2011-09-28 | 皇家飞利浦电子股份有限公司 | 用于生成深度图的方法和设备 |
JP2013228334A (ja) * | 2012-04-26 | 2013-11-07 | Topcon Corp | 三次元計測システム及び三次元計測方法及び三次元計測プログラム |
Family Cites Families (42)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2572286B2 (ja) * | 1989-12-15 | 1997-01-16 | 株式会社豊田中央研究所 | 3次元形状寸法計測装置 |
JPH11108633A (ja) * | 1997-09-30 | 1999-04-23 | Peteio:Kk | 3次元形状計測装置及びそれを用いた3次元彫刻装置 |
US6912293B1 (en) * | 1998-06-26 | 2005-06-28 | Carl P. Korobkin | Photogrammetry engine for model construction |
JP2001012922A (ja) * | 1999-06-29 | 2001-01-19 | Minolta Co Ltd | 3次元データ処理装置 |
JP2001319245A (ja) * | 2000-05-02 | 2001-11-16 | Sony Corp | 画像処理装置および方法、並びに記録媒体 |
JP2003016463A (ja) * | 2001-07-05 | 2003-01-17 | Toshiba Corp | 図形の輪郭の抽出方法、パターン検査方法、パターン検査装置、プログラムおよびこれを格納したコンピュータ読み取り可能な記録媒体 |
US20110057930A1 (en) * | 2006-07-26 | 2011-03-10 | Inneroptic Technology Inc. | System and method of using high-speed, high-resolution depth extraction to provide three-dimensional imagery for endoscopy |
WO2010037512A1 (en) * | 2008-10-02 | 2010-04-08 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Intermediate view synthesis and multi-view data signal extraction |
US8553973B2 (en) * | 2009-07-07 | 2013-10-08 | University Of Basel | Modeling methods and systems |
EP2272417B1 (en) * | 2009-07-10 | 2016-11-09 | GE Inspection Technologies, LP | Fringe projection system for a probe suitable for phase-shift analysis |
WO2011036618A2 (en) * | 2009-09-22 | 2011-03-31 | Pebblestech Ltd. | Remote control of computer devices |
US9870068B2 (en) * | 2010-09-19 | 2018-01-16 | Facebook, Inc. | Depth mapping with a head mounted display using stereo cameras and structured light |
KR20140005257A (ko) * | 2011-01-21 | 2014-01-14 | 톰슨 라이센싱 | 기하학적 기반 인트라 예측을 위한 방법 및 장치 |
US8724887B2 (en) * | 2011-02-03 | 2014-05-13 | Microsoft Corporation | Environmental modifications to mitigate environmental factors |
US9536312B2 (en) * | 2011-05-16 | 2017-01-03 | Microsoft Corporation | Depth reconstruction using plural depth capture units |
US20120314031A1 (en) * | 2011-06-07 | 2012-12-13 | Microsoft Corporation | Invariant features for computer vision |
US9131223B1 (en) * | 2011-07-07 | 2015-09-08 | Southern Methodist University | Enhancing imaging performance through the use of active illumination |
US9002099B2 (en) * | 2011-09-11 | 2015-04-07 | Apple Inc. | Learning-based estimation of hand and finger pose |
US9117295B2 (en) * | 2011-12-20 | 2015-08-25 | Adobe Systems Incorporated | Refinement of depth maps by fusion of multiple estimates |
JP6041513B2 (ja) * | 2012-04-03 | 2016-12-07 | キヤノン株式会社 | 画像処理装置、画像処理方法及びプログラム |
EP2674913B1 (en) * | 2012-06-14 | 2014-07-23 | Softkinetic Software | Three-dimensional object modelling fitting & tracking. |
US8805057B2 (en) * | 2012-07-31 | 2014-08-12 | Mitsubishi Electric Research Laboratories, Inc. | Method and system for generating structured light with spatio-temporal patterns for 3D scene reconstruction |
US9514522B2 (en) * | 2012-08-24 | 2016-12-06 | Microsoft Technology Licensing, Llc | Depth data processing and compression |
EP2904581B1 (en) * | 2012-10-01 | 2016-12-07 | Telefonaktiebolaget LM Ericsson (publ) | Method and apparatus for determining a depth of a target object |
RU2012145349A (ru) * | 2012-10-24 | 2014-05-10 | ЭлЭсАй Корпорейшн | Способ и устройство обработки изображений для устранения артефактов глубины |
US8792969B2 (en) * | 2012-11-19 | 2014-07-29 | Xerox Corporation | Respiratory function estimation from a 2D monocular video |
RU2012154657A (ru) * | 2012-12-17 | 2014-06-27 | ЭлЭсАй Корпорейшн | Способы и устройство для объединения изображений с глубиной, генерированных с использованием разных способов формирования изображений с глубиной |
JP6071522B2 (ja) * | 2012-12-18 | 2017-02-01 | キヤノン株式会社 | 情報処理装置および情報処理方法 |
RU2013106513A (ru) * | 2013-02-14 | 2014-08-20 | ЭлЭсАй Корпорейшн | Способ и устройство для улучшения изображения и подтверждения границ с использованием по меньшей мере одного дополнительного изображения |
WO2014155715A1 (ja) * | 2013-03-29 | 2014-10-02 | 株式会社日立製作所 | 物体認識装置および物体認識方法並びにプログラム |
US9373171B2 (en) * | 2013-07-22 | 2016-06-21 | Stmicroelectronics S.R.L. | Method for generating a depth map, related system and computer program product |
JP6547104B2 (ja) * | 2013-10-23 | 2019-07-24 | フェイスブック・テクノロジーズ・リミテッド・ライアビリティ・カンパニーFacebook Technologies, Llc | 動的構造化光を用いた三次元深度マッピング |
US20150193971A1 (en) * | 2014-01-03 | 2015-07-09 | Motorola Mobility Llc | Methods and Systems for Generating a Map including Sparse and Dense Mapping Information |
JP6359466B2 (ja) * | 2014-01-13 | 2018-07-18 | フェイスブック,インク. | サブ解像度での光学的検出 |
US9519060B2 (en) * | 2014-05-27 | 2016-12-13 | Xerox Corporation | Methods and systems for vehicle classification from laser scans using global alignment |
US9582888B2 (en) * | 2014-06-19 | 2017-02-28 | Qualcomm Incorporated | Structured light three-dimensional (3D) depth map based on content filtering |
US9752864B2 (en) * | 2014-10-21 | 2017-09-05 | Hand Held Products, Inc. | Handheld dimensioning system with feedback |
US9934574B2 (en) * | 2015-02-25 | 2018-04-03 | Facebook, Inc. | Using intensity variations in a light pattern for depth mapping of objects in a volume |
EP3123288A4 (en) * | 2015-02-25 | 2017-11-22 | Facebook, Inc. | Identifying an object in a volume based on characteristics of light reflected by the object |
US9694498B2 (en) * | 2015-03-30 | 2017-07-04 | X Development Llc | Imager for detecting visual light and projected patterns |
US9679192B2 (en) * | 2015-04-24 | 2017-06-13 | Adobe Systems Incorporated | 3-dimensional portrait reconstruction from a single photo |
JP6377863B2 (ja) * | 2015-05-13 | 2018-08-22 | フェイスブック,インク. | 反射マップ表現による奥行きマップ表現の増補 |
-
2016
- 2016-01-05 CN CN201680013804.2A patent/CN107408204B/zh not_active Expired - Fee Related
- 2016-01-05 JP JP2017535872A patent/JP6782239B2/ja not_active Expired - Fee Related
- 2016-01-05 EP EP16735304.4A patent/EP3243188A4/en not_active Withdrawn
- 2016-01-05 US US14/988,411 patent/US20160196657A1/en not_active Abandoned
- 2016-01-05 WO PCT/US2016/012197 patent/WO2016112019A1/en active Application Filing
- 2016-01-05 KR KR1020177021149A patent/KR20170104506A/ko active IP Right Grant
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101542529A (zh) * | 2006-11-21 | 2009-09-23 | 皇家飞利浦电子股份有限公司 | 图像的深度图的生成 |
CN102203829A (zh) * | 2008-11-04 | 2011-09-28 | 皇家飞利浦电子股份有限公司 | 用于生成深度图的方法和设备 |
JP2013228334A (ja) * | 2012-04-26 | 2013-11-07 | Topcon Corp | 三次元計測システム及び三次元計測方法及び三次元計測プログラム |
Non-Patent Citations (2)
Title |
---|
CAMPLANI 等: "Efficient spatio-temporal hole filling strategy for Kinect depth maps", 《PROC. SPIE 8290, THREE-DIMENSIONAL IMAGE PROCESSING (3DIP) AND APPLICATIONS II》 * |
MING-YU LIU 等: "Joint Geodesic Upsampling of Depth Images", 《2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION》 * |
Also Published As
Publication number | Publication date |
---|---|
KR20170104506A (ko) | 2017-09-15 |
CN107408204B (zh) | 2021-03-09 |
EP3243188A4 (en) | 2018-08-22 |
WO2016112019A1 (en) | 2016-07-14 |
JP2018507399A (ja) | 2018-03-15 |
US20160196657A1 (en) | 2016-07-07 |
JP6782239B2 (ja) | 2020-11-11 |
EP3243188A1 (en) | 2017-11-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
GB2564794B (en) | Image-stitching for dimensioning | |
TWI536318B (zh) | 深度測量之品質提升 | |
CN109658515B (zh) | 点云网格化方法、装置、设备及计算机存储介质 | |
Choe et al. | Exploiting shading cues in kinect ir images for geometry refinement | |
KR101283262B1 (ko) | 영상 처리 방법 및 장치 | |
JP7253323B2 (ja) | 3次元計測システム及び3次元計測方法 | |
CN107408204A (zh) | 使用图案化光提供深度图的方法和系统 | |
JP2018055675A (ja) | 3d画像データにおける3dポーズの改良されたスコアリング及び偽ポイント除去のためのシステム及び方法 | |
US20140111507A1 (en) | 3-dimensional shape reconstruction device using depth image and color image and the method | |
JP2021520008A (ja) | 車両検査システムとその方法 | |
JP6596433B2 (ja) | 2つのカメラからの曲線の集合の構造化光整合 | |
JP2020515931A (ja) | シーンのセグメンテーションと3d再構築を組み合わせるための方法及び装置 | |
JP2018508019A (ja) | 光パターンの強度変動を利用した体積内の物体の深さマッピング | |
CN107924461A (zh) | 用于多因素图像特征配准和跟踪的方法、电路、设备、系统及相关计算机可执行代码 | |
CN107949851B (zh) | 在场景内的物体的端点的快速和鲁棒识别 | |
Hernandez et al. | Near laser-scan quality 3-D face reconstruction from a low-quality depth stream | |
JP2016071645A (ja) | オブジェクト3次元モデル復元方法、装置およびプログラム | |
JP6425406B2 (ja) | 情報処理装置、情報処理方法、プログラム | |
JP6579659B2 (ja) | 光源推定装置及びプログラム | |
JP5620741B2 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
JP2004046464A (ja) | 移動物体3次元位置推定装置及びその方法、プログラム並びにその記録媒体 | |
Karbasi et al. | Analysis and enhancement of the denoising depth data using Kinect through iterative technique | |
US8948461B1 (en) | Method and system for estimating the three dimensional position of an object in a three dimensional physical space | |
Guðmundsson et al. | Improved 3D reconstruction in smart-room environments using ToF imaging | |
JP2017103607A (ja) | 画像処理装置、画像処理方法及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20190327 Address after: California, USA Applicant after: Facebook Technologies, LLC Address before: American California Applicant before: Facebook, Inc. |
|
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP01 | Change in the name or title of a patent holder | ||
CP01 | Change in the name or title of a patent holder |
Address after: California, USA Patentee after: Yuan Platform Technology Co.,Ltd. Address before: California, USA Patentee before: Facebook Technologies, LLC |
|
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20210309 |