KR102006043B1 - 깊이 카메라를 이용한 머리 포즈 추적 기법 - Google Patents

깊이 카메라를 이용한 머리 포즈 추적 기법 Download PDF

Info

Publication number
KR102006043B1
KR102006043B1 KR1020147022170A KR20147022170A KR102006043B1 KR 102006043 B1 KR102006043 B1 KR 102006043B1 KR 1020147022170 A KR1020147022170 A KR 1020147022170A KR 20147022170 A KR20147022170 A KR 20147022170A KR 102006043 B1 KR102006043 B1 KR 102006043B1
Authority
KR
South Korea
Prior art keywords
frame
color image
image frame
transformation matrix
last
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
KR1020147022170A
Other languages
English (en)
Korean (ko)
Other versions
KR20140126707A (ko
Inventor
지쳉 리우
젠규 장
제닝 리
Original Assignee
마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 filed Critical 마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Publication of KR20140126707A publication Critical patent/KR20140126707A/ko
Application granted granted Critical
Publication of KR102006043B1 publication Critical patent/KR102006043B1/ko
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Image Analysis (AREA)
  • Length Measuring Devices By Optical Means (AREA)
KR1020147022170A 2012-02-08 2013-01-14 깊이 카메라를 이용한 머리 포즈 추적 기법 Expired - Fee Related KR102006043B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/369,168 2012-02-08
US13/369,168 US9529426B2 (en) 2012-02-08 2012-02-08 Head pose tracking using a depth camera
PCT/US2013/021353 WO2013119352A1 (en) 2012-02-08 2013-01-14 Head pose tracking using a depth camera

Publications (2)

Publication Number Publication Date
KR20140126707A KR20140126707A (ko) 2014-10-31
KR102006043B1 true KR102006043B1 (ko) 2019-07-31

Family

ID=48902542

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020147022170A Expired - Fee Related KR102006043B1 (ko) 2012-02-08 2013-01-14 깊이 카메라를 이용한 머리 포즈 추적 기법

Country Status (6)

Country Link
US (1) US9529426B2 (enExample)
EP (1) EP2813082B1 (enExample)
JP (1) JP6198230B2 (enExample)
KR (1) KR102006043B1 (enExample)
CN (1) CN104106262B (enExample)
WO (1) WO2013119352A1 (enExample)

Families Citing this family (67)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2984057B1 (fr) 2011-12-13 2014-01-03 Solidanim Systeme de tournage de film video
GB201208088D0 (en) * 2012-05-09 2012-06-20 Ncam Sollutions Ltd Ncam
US10365711B2 (en) * 2012-05-17 2019-07-30 The University Of North Carolina At Chapel Hill Methods, systems, and computer readable media for unified scene acquisition and pose tracking in a wearable display
WO2014089542A1 (en) * 2012-12-06 2014-06-12 Eyefluence, Inc. Eye tracking wearable devices and methods for use
WO2014160342A1 (en) 2013-03-13 2014-10-02 The University Of North Carolina At Chapel Hill Low latency stabilization for head-worn displays
US8995754B2 (en) * 2013-05-30 2015-03-31 Xerox Corporation Estimating a pose of a camera for volume estimation
US9336440B2 (en) * 2013-11-25 2016-05-10 Qualcomm Incorporated Power efficient use of a depth sensor on a mobile device
US9600925B2 (en) * 2014-01-06 2017-03-21 Oculus Vr, Llc Calibration of multiple rigid bodies in a virtual reality system
US9437000B2 (en) * 2014-02-20 2016-09-06 Google Inc. Odometry feature matching
JP2017512398A (ja) * 2014-02-27 2017-05-18 トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ 映像を提示する方法及び装置
US9495801B2 (en) 2014-05-01 2016-11-15 Microsoft Technology Licensing, Llc Pose tracking an augmented reality device
DE102014106718B4 (de) * 2014-05-13 2022-04-07 Immersight Gmbh System, welches eine Blickfelddarstellung in einer gegenständlichen Lage in einem veränderbaren Raumwinkelbereich darbietet
US9727776B2 (en) * 2014-05-27 2017-08-08 Microsoft Technology Licensing, Llc Object orientation estimation
US20160027220A1 (en) * 2014-07-24 2016-01-28 JRC Integrated Systems, Inc. Low latency methodologies for a headset-mounted camera on virtual reality displays
US20160077166A1 (en) * 2014-09-12 2016-03-17 InvenSense, Incorporated Systems and methods for orientation prediction
CN104346816B (zh) * 2014-10-11 2017-04-19 京东方科技集团股份有限公司 一种深度确定方法、装置及电子设备
WO2016073557A1 (en) 2014-11-04 2016-05-12 The University Of North Carolina At Chapel Hill Minimal-latency tracking and display for matching real and virtual worlds
GB2532461A (en) * 2014-11-19 2016-05-25 Bae Systems Plc System and method for position tracking in a head mounted display
WO2017005591A1 (en) * 2015-07-07 2017-01-12 Koninklijke Philips N.V. Apparatus and method for motion tracking of at least a portion of a limb
US10360718B2 (en) * 2015-08-14 2019-07-23 Samsung Electronics Co., Ltd. Method and apparatus for constructing three dimensional model of object
CN106488204B (zh) * 2015-09-02 2018-06-15 财团法人工业技术研究院 具备自身校准的深度摄影装置以及自身校准方法
US10742961B2 (en) 2015-09-02 2020-08-11 Industrial Technology Research Institute Depth sensing apparatus with self-calibration and self-calibration method thereof
KR102371634B1 (ko) * 2015-09-10 2022-03-08 엘지이노텍 주식회사 스테레오 카메라의 거리 추출 방법
CA3005894A1 (en) 2015-11-20 2017-05-26 Magic Leap, Inc. Methods and systems for large-scale determination of rgbd camera poses
US9872011B2 (en) * 2015-11-24 2018-01-16 Nokia Technologies Oy High-speed depth sensing with a hybrid camera setup
EP3386389B1 (en) 2015-12-11 2020-03-11 Brainlab AG Determination of center of rotation of a bone
US10565723B2 (en) * 2016-02-02 2020-02-18 Samsung Electronics Co., Ltd. Systems and methods for drift correction
CN107122002A (zh) * 2016-02-24 2017-09-01 北京锤子数码科技有限公司 一种头戴式可视设备
CN106095090A (zh) * 2016-06-07 2016-11-09 北京行云时空科技有限公司 基于智能系统的空间场景的操控方法、装置和系统
CN106325517A (zh) * 2016-08-29 2017-01-11 袁超 一种基于虚拟现实的目标对象触发方法、系统和穿戴设备
FR3057347B1 (fr) * 2016-10-06 2021-05-28 Univ Aix Marseille Systeme de mesure de la distance d'un obstacle par flux optique
US10499997B2 (en) 2017-01-03 2019-12-10 Mako Surgical Corp. Systems and methods for surgical navigation
CN108335327B (zh) * 2017-01-19 2021-09-24 富士通株式会社 摄像机姿态估计方法和摄像机姿态估计装置
US10698068B2 (en) * 2017-03-24 2020-06-30 Samsung Electronics Co., Ltd. System and method for synchronizing tracking points
EP3388863B1 (en) * 2017-04-10 2025-03-12 Bea S.A. Sensor for controlling an automatic door
EP3616400B1 (en) * 2017-04-28 2024-10-16 Samsung Electronics Co., Ltd. Method for providing content and apparatus therefor
US20180322689A1 (en) * 2017-05-05 2018-11-08 University Of Maryland, College Park Visualization and rendering of images to enhance depth perception
US10809380B2 (en) 2017-05-15 2020-10-20 Ouster, Inc. Augmenting panoramic LIDAR results with color
US10621751B2 (en) * 2017-06-16 2020-04-14 Seiko Epson Corporation Information processing device and computer program
CN107516327B (zh) * 2017-08-21 2023-05-16 腾讯科技（上海）有限公司 基于多层滤波确定相机姿态矩阵的方法及装置、设备
TWI652447B (zh) 2017-09-12 2019-03-01 財團法人成大研究發展基金會 適用於疊代最近點法以選擇關鍵圖框的系統與方法
US10839547B2 (en) * 2017-09-28 2020-11-17 Samsung Electronics Co., Ltd. Camera pose determination and tracking
GB2569803B (en) * 2017-12-22 2021-11-24 Novarum Dx Ltd Analysis of a captured image to determine a test outcome
US10921881B2 (en) * 2018-01-18 2021-02-16 Valve Corporation Position tracking system for head-mounted displays that includes sensor integrated circuits
US10559276B2 (en) 2018-02-03 2020-02-11 Facebook Technologies, Llc Apparatus, system, and method for mitigating motion-to-photon latency in head-mounted displays
US10706813B1 (en) 2018-02-03 2020-07-07 Facebook Technologies, Llc Apparatus, system, and method for mitigating motion-to-photon latency in head-mounted displays
JP6516042B2 (ja) * 2018-05-11 2019-05-22 セイコーエプソン株式会社 信号処理装置、検出装置、センサー、電子機器及び移動体
WO2019222621A1 (en) * 2018-05-17 2019-11-21 Kaon Interactive Methods for visualizing and interacting with a trhee dimensional object in a collaborative augmented reality environment and apparatuses thereof
US10678325B2 (en) * 2018-05-22 2020-06-09 Facebook Technologies, Llc Apparatus, system, and method for accelerating positional tracking of head-mounted displays
US10410372B1 (en) 2018-06-14 2019-09-10 The University Of North Carolina At Chapel Hill Methods, systems, and computer-readable media for utilizing radial distortion to estimate a pose configuration
KR20210093866A (ko) * 2018-11-27 2021-07-28 소니그룹주식회사 정보 처리 장치, 정보 처리 방법 및 프로그램
CN109960402B (zh) * 2018-12-18 2022-04-01 重庆邮电大学 一种基于点云和视觉特征融合的虚实注册方法
KR102256050B1 (ko) * 2019-01-28 2021-05-25 한국기술교육대학교 산학협력단 웨어러블 장치 및 이를 포함하는 컴퓨터 시각 증후군 방지 시스템
KR102100639B1 (ko) * 2019-05-28 2020-04-14 주식회사 젠다카디언 낙상 및 기립 감지 장치
US11153488B2 (en) 2019-09-26 2021-10-19 United States Of America, As Represented By The Secretary Of The Army Variable latency and frame rate camera
US11061469B2 (en) * 2019-11-20 2021-07-13 XRSpace CO., LTD. Head mounted display system and rotation center correcting method thereof
CN111242090B (zh) * 2020-01-22 2023-06-23 腾讯科技（深圳）有限公司 基于人工智能的人脸识别方法、装置、设备及介质
CN111369596B (zh) * 2020-02-26 2022-07-05 华南理工大学 一种基于视频监控的手扶电梯客流量统计方法
US11625857B1 (en) * 2020-06-15 2023-04-11 Apple Inc. Enhanced content positioning
DE102020121408A1 (de) 2020-08-14 2022-02-17 Bayerische Motoren Werke Aktiengesellschaft Computerimplementiertes Verfahren und System zur Vorhersage einer Orientierung und räumlichen Position einer am Kopf eines Nutzers montierbaren Anzeigevorrichtung
US20210110606A1 (en) * 2020-12-23 2021-04-15 Intel Corporation Natural and immersive data-annotation system for space-time artificial intelligence in robotics and smart-spaces
EP4645041A2 (en) * 2020-12-30 2025-11-05 Snap Inc. Periodic parameter estimation visual-inertial tracking systems
EP4399682A4 (en) * 2021-09-08 2025-06-18 Magic Leap, Inc. CAMERA CALIBRATION WITH DEPTH SENSOR DATA
CN113900516A (zh) * 2021-09-27 2022-01-07 阿里巴巴达摩院(杭州)科技有限公司 数据处理方法、装置、电子设备和存储介质
CN114007099A (zh) * 2021-11-04 2022-02-01 北京搜狗科技发展有限公司 一种视频处理方法、装置和用于视频处理的装置
CN116704587B (zh) * 2023-08-02 2023-10-20 山东建筑大学 融合纹理信息和深度信息的多人头部姿态估计方法及系统
CN117745757B (zh) * 2023-10-24 2025-09-23 珠海莫界科技有限公司 目标跟踪的方法、装置、终端设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020105484A1 (en) 2000-09-25 2002-08-08 Nassir Navab System and method for calibrating a monocular optical see-through head-mounted display system for augmented reality
JP2005033319A (ja) 2003-07-08 2005-02-03 Canon Inc 位置姿勢計測方法及び装置
US20100103196A1 (en) 2008-10-27 2010-04-29 Rakesh Kumar System and method for generating a mixed reality environment
US20100245387A1 (en) 2005-04-11 2010-09-30 Systems Technology, Inc. Systems and methods for combining virtual and real-time physical environments

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6414731B2 (en) * 1990-11-30 2002-07-02 Sun Microsystems, Inc. Low cost virtual reality system
US6064749A (en) 1996-08-02 2000-05-16 Hirota; Gentaro Hybrid tracking for augmented reality using both camera motion detection and landmark tracking
WO1998050878A1 (en) 1997-05-05 1998-11-12 Shell Oil Company Visual recognition method
JP2001101410A (ja) * 1999-09-28 2001-04-13 Suzuki Motor Corp 変換行列データ生成方法及び較正治具並びに三次元計測システム
US7203356B2 (en) * 2002-04-11 2007-04-10 Canesta, Inc. Subject segmentation and tracking using 3D sensing technology for video compression in multimedia applications
US8570378B2 (en) 2002-07-27 2013-10-29 Sony Computer Entertainment Inc. Method and apparatus for tracking three-dimensional movements of an object using a depth sensing camera
JP2004085476A (ja) 2002-08-28 2004-03-18 Sony Corp ヘッドトラッキング方法及び装置
US20070035562A1 (en) 2002-09-25 2007-02-15 Azuma Ronald T Method and apparatus for image enhancement
US7002551B2 (en) 2002-09-25 2006-02-21 Hrl Laboratories, Llc Optical see-through augmented reality modified-scale display
US7372977B2 (en) 2003-05-29 2008-05-13 Honda Motor Co., Ltd. Visual tracking using depth data
JP2005147894A (ja) * 2003-11-17 2005-06-09 Canon Inc 計測方法、計測装置
US7542210B2 (en) * 2006-06-29 2009-06-02 Chirieleison Sr Anthony Eye tracking head mounted display
CN103258184B (zh) 2008-02-27 2017-04-12 索尼计算机娱乐美国有限责任公司 用于捕获场景的深度数据并且应用计算机动作的方法
KR101537948B1 (ko) 2008-12-16 2015-07-20 삼성전자주식회사 얼굴 포즈 추정을 이용한 촬영 방법 및 장치
US8970690B2 (en) 2009-02-13 2015-03-03 Metaio Gmbh Methods and systems for determining the pose of a camera with respect to at least one object of a real environment
US8831277B1 (en) * 2009-10-02 2014-09-09 Rockwell Collins, Inc. Optical helmet tracking system
KR101313797B1 (ko) 2009-12-18 2013-10-01 한국전자통신연구원 머리 위치 추적을 이용한 입체 영상 표시 장치 및 이의 동작 방법

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020105484A1 (en) 2000-09-25 2002-08-08 Nassir Navab System and method for calibrating a monocular optical see-through head-mounted display system for augmented reality
JP2005033319A (ja) 2003-07-08 2005-02-03 Canon Inc 位置姿勢計測方法及び装置
US20100245387A1 (en) 2005-04-11 2010-09-30 Systems Technology, Inc. Systems and methods for combining virtual and real-time physical environments
US20100103196A1 (en) 2008-10-27 2010-04-29 Rakesh Kumar System and method for generating a mixed reality environment

Also Published As

Publication number Publication date
WO2013119352A1 (en) 2013-08-15
EP2813082A1 (en) 2014-12-17
US9529426B2 (en) 2016-12-27
JP2015513662A (ja) 2015-05-14
KR20140126707A (ko) 2014-10-31
US20130201291A1 (en) 2013-08-08
EP2813082A4 (en) 2015-09-23
EP2813082B1 (en) 2018-03-28
CN104106262B (zh) 2017-01-18
JP6198230B2 (ja) 2017-09-20
CN104106262A (zh) 2014-10-15

Similar Documents

Publication Publication Date Title
KR102006043B1 (ko) 깊이 카메라를 이용한 머리 포즈 추적 기법
US20230360242A1 (en) System and method for concurrent odometry and mapping
CN110047104B (zh) 对象检测和跟踪方法、头戴式显示装置和存储介质
CN109146965B (zh) 信息处理装置、计算机可读介质和头戴式显示装置
JP7585600B2 (ja) データ処理方法、装置、データ処理システム、電子機器及びコンピュータプログラム
CN110310329B (zh) 操作显示设备的方法、信息处理系统及非暂时性存储介质
KR101776622B1 (ko) 다이렉트 트래킹을 이용하여 이동 로봇의 위치를 인식하기 위한 장치 및 그 방법
CN108700946B (zh) 用于并行测距和建图的故障检测和恢复的系统和方法
KR101725060B1 (ko) 그래디언트 기반 특징점을 이용한 이동 로봇의 위치를 인식하기 위한 장치 및 그 방법
KR101776621B1 (ko) 에지 기반 재조정을 이용하여 이동 로봇의 위치를 인식하기 위한 장치 및 그 방법
KR20150144728A (ko) 이동 로봇의 맵을 업데이트하기 위한 장치 및 그 방법
KR20150144730A (ko) ADoG 기반 특징점을 이용한 이동 로봇의 위치를 인식하기 위한 장치 및 그 방법
US20220198697A1 (en) Information processing apparatus, information processing method, and program
WO2015040119A1 (en) 3d reconstruction
US11847259B1 (en) Map-aided inertial odometry with neural network for augmented reality devices
Huai et al. Real-time large scale 3D reconstruction by fusing Kinect and IMU data
WO2023090213A1 (ja) 情報処理装置、情報処理方法及びプログラム
CN118941633B (zh) 设备的定位方法、计算机设备及介质
JP6154759B2 (ja) カメラパラメータ推定装置、カメラパラメータ推定方法及びカメラパラメータ推定プログラム
CN117128961A (zh) 水下机器人定位方法、装置、电子设备和存储介质
CN116704022A (zh) 基于结构线段的vio系统的位姿估计方法、装置及介质

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

N231 Notification of change of applicant
PN2301 Change of applicant

St.27 status event code: A-3-3-R10-R13-asn-PN2301

St.27 status event code: A-3-3-R10-R11-asn-PN2301

A201 Request for examination
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

PC1903 Unpaid annual fee

St.27 status event code: A-4-4-U10-U13-oth-PC1903

Not in force date: 20240726

Payment event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

PC1903 Unpaid annual fee

St.27 status event code: N-4-6-H10-H13-oth-PC1903

Ip right cessation event data comment text: Termination Category : DEFAULT_OF_REGISTRATION_FEE

Not in force date: 20240726