KR101954855B1 - 볼륨 내 물체의 심도 맵핑을 위한 광 패턴의 강도 변화의 사용 - Google Patents

볼륨 내 물체의 심도 맵핑을 위한 광 패턴의 강도 변화의 사용 Download PDF

Info

Publication number
KR101954855B1
KR101954855B1 KR1020177026659A KR20177026659A KR101954855B1 KR 101954855 B1 KR101954855 B1 KR 101954855B1 KR 1020177026659 A KR1020177026659 A KR 1020177026659A KR 20177026659 A KR20177026659 A KR 20177026659A KR 101954855 B1 KR101954855 B1 KR 101954855B1
Authority
KR
South Korea
Prior art keywords
intensity
stripe
light
additional
light pattern
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
KR1020177026659A
Other languages
English (en)
Korean (ko)
Other versions
KR20170120655A (ko
Inventor
나다브 그로싱거
니타이 로마노
Original Assignee
페이스북, 인크.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 페이스북, 인크. filed Critical 페이스북, 인크.
Publication of KR20170120655A publication Critical patent/KR20170120655A/ko
Application granted granted Critical
Publication of KR101954855B1 publication Critical patent/KR101954855B1/ko
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/50—Depth or shape recovery
    • G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/14—Measuring arrangements characterised by the use of optical techniques for measuring distance or clearance between spaced objects or spaced apertures
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/22—Measuring arrangements characterised by the use of optical techniques for measuring depth
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00—Measuring arrangements characterised by the use of optical techniques
    • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • G01B11/25—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures by projecting a pattern, e.g. one or more lines, moiré fringes on the object
    • G06K9/00335—
    • G06K9/00355—
    • G06K9/00362—
    • G06K9/00375—
    • G06K9/2036—
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/145—Illumination specially adapted for pattern recognition, e.g. using gratings
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107—Static hand or arm
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20—Movements or behaviour, e.g. gesture recognition
    • G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Optics & Photonics (AREA)
  • Artificial Intelligence (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Length Measuring Devices By Optical Means (AREA)
KR1020177026659A 2015-02-25 2016-02-24 볼륨 내 물체의 심도 맵핑을 위한 광 패턴의 강도 변화의 사용 Expired - Fee Related KR101954855B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562120500P 2015-02-25 2015-02-25
US62/120,500 2015-02-25
PCT/US2016/019375 WO2016138143A1 (en) 2015-02-25 2016-02-24 Using intensity variations in a light pattern for depth mapping of objects in a volume

Publications (2)

Publication Number Publication Date
KR20170120655A KR20170120655A (ko) 2017-10-31
KR101954855B1 true KR101954855B1 (ko) 2019-03-06

Family

ID=56789621

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020177026659A Expired - Fee Related KR101954855B1 (ko) 2015-02-25 2016-02-24 볼륨 내 물체의 심도 맵핑을 위한 광 패턴의 강도 변화의 사용

Country Status (6)

Country Link
US (1) US9934574B2 (enExample)
EP (2) EP4141793A1 (enExample)
JP (1) JP6621836B2 (enExample)
KR (1) KR101954855B1 (enExample)
CN (1) CN107532885B (enExample)
WO (1) WO2016138143A1 (enExample)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9507411B2 (en) * 2009-09-22 2016-11-29 Facebook, Inc. Hand tracker for device with display
CN107408204B (zh) * 2015-01-06 2021-03-09 脸谱科技有限责任公司 使用图案化光提供深度图的方法和系统
US10066933B2 (en) 2015-05-04 2018-09-04 Facebook, Inc. Camera depth mapping using structured light patterns
US10785393B2 (en) * 2015-05-22 2020-09-22 Facebook, Inc. Methods and devices for selective flash illumination
US9858672B2 (en) 2016-01-15 2018-01-02 Oculus Vr, Llc Depth mapping using structured light and time of flight
US10089738B2 (en) * 2016-08-30 2018-10-02 Microsoft Technology Licensing, Llc Temperature compensation for structured light depth imaging system
US10620316B2 (en) 2017-05-05 2020-04-14 Qualcomm Incorporated Systems and methods for generating a structured light depth map with a non-uniform codeword pattern
CN110892716B (zh) * 2017-07-12 2022-11-22 镜泰公司 从环境中用于获取信息的系统及方法
TWI647661B (zh) * 2017-08-10 2019-01-11 緯創資通股份有限公司 影像深度感測方法與影像深度感測裝置
CN107703641B (zh) * 2017-09-08 2019-12-13 深圳奥比中光科技有限公司 一种结构光投影模组和深度相机
CN107450190B (zh) 2017-09-08 2019-12-13 深圳奥比中光科技有限公司 一种衍射光学元件及配制方法
US20190220677A1 (en) * 2018-01-17 2019-07-18 GM Global Technology Operations LLC Structured light illumination system for object detection
CN108594454B (zh) 2018-03-23 2019-12-13 深圳奥比中光科技有限公司 一种结构光投影模组和深度相机
US11182914B2 (en) * 2018-05-21 2021-11-23 Facebook Technologies, Llc Dynamic structured light for depth sensing systems based on contrast in a local area
US10877622B2 (en) * 2018-08-29 2020-12-29 Facebook Technologies, Llc Detection of structured light for depth sensing
CN109712350B (zh) * 2019-01-31 2024-06-11 浙江云澎科技有限公司 一种智能识别的自助结算机
JP7251240B2 (ja) * 2019-03-20 2023-04-04 株式会社リコー 光学装置、検出装置及び電子機器
US12386188B2 (en) * 2019-10-07 2025-08-12 Trinamix Gmbh Projector for illuminating at least one object
US10890839B1 (en) * 2019-11-06 2021-01-12 Himax Technologies Limited Structured light imaging device
WO2021170791A1 (en) * 2020-02-28 2021-09-02 Trinamix Gmbh Gesture recognition
US12390124B2 (en) * 2021-01-27 2025-08-19 Covidien Lp Systems and methods for non-contact respiratory monitoring
US12475583B2 (en) * 2023-04-28 2025-11-18 Qualcomm Incorporated Stereo vision with census transform
WO2025064689A1 (en) * 2023-09-19 2025-03-27 More, Inc. Illumination, image capture and/or image processing methods and apparatus for depth determination and/or other purposes

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130131836A1 (en) 2011-11-21 2013-05-23 Microsoft Corporation System for controlling light enabled devices
US20140267701A1 (en) 2013-03-12 2014-09-18 Ziv Aviv Apparatus and techniques for determining object depth in images
US20150042680A1 (en) 2013-08-08 2015-02-12 Pebbles Ltd. Method and device for controlling a near eye display

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3388684B2 (ja) * 1997-03-05 2003-03-24 株式会社オプトン ３次元形状測定方法
US6341016B1 (en) * 1999-08-06 2002-01-22 Michael Malione Method and apparatus for measuring three-dimensional shape of object
KR100544979B1 (ko) * 2003-11-28 2006-01-24 한국전자통신연구원 물체의 반사율 획득 시스템 및 물체 표현 방법
WO2007105215A2 (en) 2006-03-14 2007-09-20 Prime Sense Ltd. Depth-varying light fields for three dimensional sensing
US20090189858A1 (en) * 2008-01-30 2009-07-30 Jeff Lev Gesture Identification Using A Structured Light Pattern
WO2011013079A1 (en) * 2009-07-30 2011-02-03 Primesense Ltd. Depth mapping based on pattern matching and stereoscopic information
CN103053167B (zh) * 2010-08-11 2016-01-20 苹果公司 扫描投影机及用于3d映射的图像捕获模块
TWI435051B (zh) * 2011-03-15 2014-04-21 Largan Precision Co Ltd 位置及深度之檢出裝置及其方法
WO2013109609A2 (en) * 2012-01-17 2013-07-25 Leap Motion, Inc. Enhanced contrast for object detection and characterization by optical imaging
EP2823462B1 (en) * 2012-03-05 2019-10-16 Microsoft Technology Licensing, LLC Generation of depth images based upon light falloff
EP2799810A1 (de) * 2013-04-30 2014-11-05 Aimess Services GmbH Vorrichtung und Verfahren zum simultanen dreidimensionalen Vermessen von Oberflächen mit mehreren Wellenlängen

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130131836A1 (en) 2011-11-21 2013-05-23 Microsoft Corporation System for controlling light enabled devices
US20140267701A1 (en) 2013-03-12 2014-09-18 Ziv Aviv Apparatus and techniques for determining object depth in images
US20150042680A1 (en) 2013-08-08 2015-02-12 Pebbles Ltd. Method and device for controlling a near eye display

Also Published As

Publication number Publication date
JP6621836B2 (ja) 2019-12-18
US9934574B2 (en) 2018-04-03
CN107532885A (zh) 2018-01-02
EP3262439B1 (en) 2022-11-02
KR20170120655A (ko) 2017-10-31
EP3262439A1 (en) 2018-01-03
US20160253812A1 (en) 2016-09-01
EP3262439A4 (en) 2019-02-27
JP2018508019A (ja) 2018-03-22
CN107532885B (zh) 2020-03-03
WO2016138143A1 (en) 2016-09-01
EP4141793A1 (en) 2023-03-01

Similar Documents

Publication Publication Date Title
KR101954855B1 (ko) 볼륨 내 물체의 심도 맵핑을 위한 광 패턴의 강도 변화의 사용
US11652965B2 (en) Method of and system for projecting digital information on a real object in a real environment
EP3788403B1 (en) Field calibration of a structured light range-sensor
KR101605224B1 (ko) 패턴 광을 이용한 깊이 정보 획득 장치 및 방법
US12075020B2 (en) Active stereo matching for depth applications
JP5643645B2 (ja) 有形物の形状の３次元測定のためのシステム及び方法
US9947098B2 (en) Augmenting a depth map representation with a reflectivity map representation
US10475196B2 (en) Hybrid depth detection and movement detection
US9648698B2 (en) Method and system for generating light pattern using polygons
KR101913179B1 (ko) 적외선 센싱 발판 장치, 이를 이용한 2차원 영상 검출 방법 및 프로그램
KR101907057B1 (ko) 구면 모델링을 통한 깊이 정보 보정 방법과 보정장치
Chien et al. Adaptive 3d reconstruction system with improved recovery of miscoded region to automatically adjust projected light patterns
TW201301078A (zh) 體感偵測方法
Kraus Wireless Optical Communication: Infrared, Time-Of-Flight, Light Fields, and Beyond
EP3104209A2 (en) Method and system for generating light pattern using polygons
Ahn et al. A Three-Dimensional Fingertip Interface

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

A201 Request for examination
E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PA0302 Request for accelerated examination

St.27 status event code: A-1-2-D10-D17-exm-PA0302

St.27 status event code: A-1-2-D10-D16-exm-PA0302

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

R17-X000 Change to representative recorded

St.27 status event code: A-5-5-R10-R17-oth-X000

PN2301 Change of applicant

St.27 status event code: A-5-5-R10-R11-asn-PN2301

PN2301 Change of applicant

St.27 status event code: A-5-5-R10-R14-asn-PN2301

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

PN2301 Change of applicant

St.27 status event code: A-5-5-R10-R13-asn-PN2301

St.27 status event code: A-5-5-R10-R11-asn-PN2301

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PN2301 Change of applicant

St.27 status event code: A-5-5-R10-R13-asn-PN2301

St.27 status event code: A-5-5-R10-R11-asn-PN2301

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

P22-X000 Classification modified

St.27 status event code: A-4-4-P10-P22-nap-X000

PC1903 Unpaid annual fee

St.27 status event code: A-4-4-U10-U13-oth-PC1903

Not in force date: 20240228

Payment event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000

PC1903 Unpaid annual fee

St.27 status event code: N-4-6-H10-H13-oth-PC1903

Ip right cessation event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

Not in force date: 20240228