CN110603510B - 虚拟现实系统中虚拟控制器的位置和取向跟踪 - Google Patents

虚拟现实系统中虚拟控制器的位置和取向跟踪 Download PDF

Info

Publication number
CN110603510B
CN110603510B CN201880029450.XA CN201880029450A CN110603510B CN 110603510 B CN110603510 B CN 110603510B CN 201880029450 A CN201880029450 A CN 201880029450A CN 110603510 B CN110603510 B CN 110603510B
Authority
CN
China
Prior art keywords
virtual
controller
joint
user
hmd
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880029450.XA
Other languages
English (en)
Chinese (zh)
Other versions
CN110603510A (zh
Inventor
萨曼莎·拉贾
曼纽尔·克里斯蒂安·克莱蒙特
沙尼·尼施瑞
丹尼尔·斯滕菲尔德
斯特凡·韦尔克
凯文·霍洛维兹
科朗坦·法蒂
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google LLC filed Critical Google LLC
Publication of CN110603510A publication Critical patent/CN110603510A/zh
Application granted granted Critical
Publication of CN110603510B publication Critical patent/CN110603510B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0383—Signal control means within the pointing device
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
  • Processing Or Creating Images (AREA)
CN201880029450.XA 2017-09-18 2018-09-17 虚拟现实系统中虚拟控制器的位置和取向跟踪 Active CN110603510B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/708,040 US10386938B2 (en) 2017-09-18 2017-09-18 Tracking of location and orientation of a virtual controller in a virtual reality system
US15/708,040 2017-09-18
PCT/US2018/051361 WO2019055929A1 (en) 2017-09-18 2018-09-17 MONITORING THE LOCATION AND ORIENTATION OF A VIRTUAL CONTROL DEVICE IN A VIRTUAL REALITY SYSTEM

Publications (2)

Publication Number Publication Date
CN110603510A CN110603510A (zh) 2019-12-20
CN110603510B true CN110603510B (zh) 2023-10-27

Family

ID=63963384

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880029450.XA Active CN110603510B (zh) 2017-09-18 2018-09-17 虚拟现实系统中虚拟控制器的位置和取向跟踪

Country Status (6)

Country Link
US (1) US10386938B2 (OSRAM)
EP (1) EP3685248B1 (OSRAM)
JP (2) JP7030854B2 (OSRAM)
KR (1) KR102338836B1 (OSRAM)
CN (1) CN110603510B (OSRAM)
WO (1) WO2019055929A1 (OSRAM)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3762809A4 (en) * 2018-03-07 2021-12-01 University of Massachusetts Medical School Office Of Technology Management SYSTEM TO FACILITATE VOICE COMMUNICATION FOR INDIVIDUALS WHO CANNOT SPEAK OR WRITE
US20190385372A1 (en) * 2018-06-15 2019-12-19 Microsoft Technology Licensing, Llc Positioning a virtual reality passthrough region at a known distance
US11126341B2 (en) * 2019-02-21 2021-09-21 Htc Corporation Object manipulating method, host device and computer readable storage medium
US11086392B1 (en) * 2019-04-09 2021-08-10 Facebook Technologies, Llc Devices, systems, and methods for virtual representation of user interface devices
US11373374B2 (en) * 2019-11-07 2022-06-28 Volvo Car Corporation Aligning the augmented reality or virtual reality world with the real world using natural position understanding
JP7589696B2 (ja) * 2020-01-17 2024-11-26 ソニーグループ株式会社 情報処理装置及び情報処理方法、コンピュータプログラム、並びに拡張現実感システム
US11435185B2 (en) * 2020-02-21 2022-09-06 Microsoft Technology Licensing, Llc Systems and methods for deep learning-based pedestrian dead reckoning for exteroceptive sensor-enabled devices
US11554320B2 (en) * 2020-09-17 2023-01-17 Bogie Inc. System and method for an interactive controller
CN113318435A (zh) * 2021-04-27 2021-08-31 青岛小鸟看看科技有限公司 手柄控制追踪器的控制方法、装置及头戴式显示设备
US11934569B2 (en) * 2021-09-24 2024-03-19 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
KR20230100472A (ko) 2021-12-28 2023-07-05 삼성전자주식회사 손의 관절에 관한 위치 정보를 획득하는 증강 현실 디바이스 및 그 동작 방법
JP7719010B2 (ja) * 2022-02-18 2025-08-05 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置およびデバイス位置推定方法
US20230419627A1 (en) * 2022-06-24 2023-12-28 Lowe's Companies, Inc. Object modeling based on properties and images of an object
WO2024136903A1 (en) * 2022-12-23 2024-06-27 Innopeak Technology, Inc. Methods and systems for defining virtual boundaries
CN116585709A (zh) * 2023-06-06 2023-08-15 北京字跳网络技术有限公司 虚拟对象的运动控制方法、装置、电子设备及存储介质
KR20250087355A (ko) 2023-12-07 2025-06-16 가톨릭대학교 산학협력단 가상 환경에서 사용자 아바타를 통한 대화형 체험 서비스 제공 방법 및 장치
JP7658021B1 (ja) * 2024-09-27 2025-04-07 株式会社コロプラ プログラムおよび情報処理システム
JP7663767B1 (ja) * 2024-09-27 2025-04-16 株式会社コロプラ プログラムおよび情報処理システム

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2937536A1 (en) * 2014-01-25 2015-07-30 Sony Interactive Entertainment America Llc Environmental interrupt in a head-mounted display and utilization of non field of view real estate
CN105009039A (zh) * 2012-11-30 2015-10-28 微软技术许可有限责任公司 使用imu的直接全息图操纵
CN105283824A (zh) * 2013-01-21 2016-01-27 微软技术许可有限责任公司 用图像投影的虚拟交互
CN106575153A (zh) * 2014-07-25 2017-04-19 微软技术许可有限责任公司 虚拟现实环境内基于注视的对象放置

Family Cites Families (36)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6104379A (en) * 1996-12-11 2000-08-15 Virtual Technologies, Inc. Forearm-supported exoskeleton hand-tracking device
US7472047B2 (en) * 1997-05-12 2008-12-30 Immersion Corporation System and method for constraining a graphical hand from penetrating simulated graphical objects
US6042555A (en) * 1997-05-12 2000-03-28 Virtual Technologies, Inc. Force-feedback interface device for the hand
JP3668663B2 (ja) * 2000-02-21 2005-07-06 日本電信電話株式会社 仮想空間における動作入力方法および装置およびその動作入力プログラムを記録した記録媒体
US7324085B2 (en) 2002-01-25 2008-01-29 Autodesk, Inc. Techniques for pointing to locations within a volumetric display
US10936074B2 (en) 2003-11-20 2021-03-02 National Institute Of Advanced Industrial Science And Technology Haptic information presentation system and method
US20160098095A1 (en) * 2004-01-30 2016-04-07 Electronic Scripting Products, Inc. Deriving Input from Six Degrees of Freedom Interfaces
US20080009771A1 (en) * 2006-03-29 2008-01-10 Joel Perry Exoskeleton
US9082213B2 (en) * 2007-11-07 2015-07-14 Canon Kabushiki Kaisha Image processing apparatus for combining real object and virtual object and processing method therefor
JP5287421B2 (ja) * 2009-03-27 2013-09-11 株式会社Ｊｖｃケンウッド 入力装置及びこれを用いた電子機器
US20110267356A1 (en) * 2010-04-29 2011-11-03 Rennuit Antoine F Lix Robert Animating a virtual object within a virtual world
US20110267357A1 (en) * 2010-04-29 2011-11-03 Rennuit Antoine Felix Robert Animating a virtual object within a virtual world
US9177409B2 (en) * 2010-04-29 2015-11-03 Naturalmotion Ltd Animating a virtual object within a virtual world
US8483877B2 (en) * 2010-09-03 2013-07-09 GM Global Technology Operations LLC Workspace safe operation of a force- or impedance-controlled robot
US9552673B2 (en) 2012-10-17 2017-01-24 Microsoft Technology Licensing, Llc Grasping virtual objects in augmented reality
EP2915025B8 (en) * 2012-11-01 2021-06-02 Eyecam, Inc. Wireless wrist computing and control device and method for 3d imaging, mapping, networking and interfacing
WO2014204330A1 (en) 2013-06-17 2014-12-24 3Divi Company Methods and systems for determining 6dof location and orientation of head-mounted display and associated user movements
US9649558B2 (en) * 2014-03-14 2017-05-16 Sony Interactive Entertainment Inc. Gaming device with rotatably placed cameras
KR102299364B1 (ko) * 2014-08-25 2021-09-07 삼성전자주식회사 웨어러블 디바이스의 센서가 측정하는 임피던스 값을 보정하는 방법 및 장치
US9690367B2 (en) 2014-12-10 2017-06-27 Sixense Entertainment, Inc. System and method for assisting a user in locating physical objects while the user is in a virtual reality environment
JP6391465B2 (ja) * 2014-12-26 2018-09-19 Kddi株式会社 ウェアラブル端末装置およびプログラム
US10725297B2 (en) * 2015-01-28 2020-07-28 CCP hf. Method and system for implementing a virtual representation of a physical environment using a virtual reality environment
US10180734B2 (en) * 2015-03-05 2019-01-15 Magic Leap, Inc. Systems and methods for augmented reality
US9898091B2 (en) * 2015-06-03 2018-02-20 Oculus Vr, Llc Virtual reality system with head-mounted display, camera and hand-held controllers
WO2016205182A1 (en) * 2015-06-15 2016-12-22 Survios, Inc. Systems and methods for immersive physical interaction with a virtual environment
US10095024B2 (en) * 2015-08-07 2018-10-09 Sony Interactive Entertainment Inc. Systems and methods for using a MEMS projector to determine an orientation of a photosensor of an HMD or another controller
WO2017037962A1 (ja) * 2015-08-28 2017-03-09 株式会社タカラトミー 頭部装着型ディスプレイを備えた情報処理装置
US10010788B2 (en) * 2015-12-21 2018-07-03 Sony Interactive Entertainment Inc. Game controller with lights visible inside and outside the game controller
US10019131B2 (en) * 2016-05-10 2018-07-10 Google Llc Two-handed object manipulations in virtual reality
US10249090B2 (en) * 2016-06-09 2019-04-02 Microsoft Technology Licensing, Llc Robust optical disambiguation and tracking of two or more hand-held controllers with passive optical and inertial tracking
WO2018022657A1 (en) * 2016-07-25 2018-02-01 Ctrl-Labs Corporation System and method for measuring the movements of articulated rigid bodies
US10723022B2 (en) * 2016-09-16 2020-07-28 Carbon Robotics, Inc. System and calibration, registration, and training methods
US10134192B2 (en) * 2016-10-17 2018-11-20 Microsoft Technology Licensing, Llc Generating and displaying a computer generated image on a future pose of a real world object
KR20190110539A (ko) * 2016-12-13 2019-09-30 딥모션, 인크. 솔버용의 다수의 힘 어레이를 사용한 향상된 가상 현실 시스템
US10444865B2 (en) * 2017-05-01 2019-10-15 Google Llc Tracking of position and orientation of objects in virtual reality systems
US11054894B2 (en) * 2017-05-05 2021-07-06 Microsoft Technology Licensing, Llc Integrated mixed-input system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105009039A (zh) * 2012-11-30 2015-10-28 微软技术许可有限责任公司 使用imu的直接全息图操纵
CN105283824A (zh) * 2013-01-21 2016-01-27 微软技术许可有限责任公司 用图像投影的虚拟交互
CA2937536A1 (en) * 2014-01-25 2015-07-30 Sony Interactive Entertainment America Llc Environmental interrupt in a head-mounted display and utilization of non field of view real estate
CN106575153A (zh) * 2014-07-25 2017-04-19 微软技术许可有限责任公司 虚拟现实环境内基于注视的对象放置

Also Published As

Publication number Publication date
CN110603510A (zh) 2019-12-20
EP3685248A1 (en) 2020-07-29
JP2020529646A (ja) 2020-10-08
KR20190136047A (ko) 2019-12-09
JP7030854B2 (ja) 2022-03-07
WO2019055929A1 (en) 2019-03-21
US20190087019A1 (en) 2019-03-21
JP2022008987A (ja) 2022-01-14
US10386938B2 (en) 2019-08-20
KR102338836B1 (ko) 2021-12-13
EP3685248B1 (en) 2022-03-30
JP7382994B2 (ja) 2023-11-17

Similar Documents

Publication Publication Date Title
CN110603510B (zh) 虚拟现实系统中虚拟控制器的位置和取向跟踪
CN110794958B (zh) 在增强/虚拟现实环境中使用的输入设备
US9367136B2 (en) Holographic object feedback
CN108139815B (zh) 用于虚拟现实内容的显示的场景和对象的分立时间扭曲
CN109643159B (zh) 在增强和/或虚拟现实环境中利用六自由度控制器操纵虚拟对象
CN107667328B (zh) 用于在增强和/或虚拟现实环境中跟踪手持设备的系统
KR101546654B1 (ko) 웨어러블 증강현실 환경에서 증강현실 서비스 제공 방법 및 장치
EP3400499B1 (en) Two-handed object manipulations in virtual reality
CN116724285A (zh) 用于控制虚拟和图形元素的微手势
CN109074149B (zh) 用于增强或虚拟现实环境的头戴式参考系中的对象跟踪
CN117178247A (zh) 用于动画化及控制虚拟和图形元素的手势
CN108073276B (zh) 增强和/或虚拟现实环境的拖拽虚拟元件
CN108139805B (zh) 用于在虚拟现实环境中的导航的控制系统
US10649616B2 (en) Volumetric multi-selection interface for selecting multiple objects in 3D space
JP7546116B2 (ja) 拡張現実のためのシステムおよび方法
Lu et al. Immersive manipulation of virtual objects through glove-based hand gesture interaction
CN108475120A (zh) 用混合现实系统的远程设备进行对象运动跟踪的方法及混合现实系统
WO2022228056A1 (zh) 一种人机交互方法及设备
CN113496168A (zh) 手语数据采集方法、设备、存储介质
Bidwe et al. A Hybrid Approach for Real-Time Hand Tracking Using Fiducial Markers and Inertial Sensors
CN119200827A (zh) 基于手持智能设备与头戴显示设备的交互方法与系统
TW201933041A (zh) 虛擬空間定位方法及裝置
JP2018181185A (ja) 力覚提示器及び仮想力覚提示装置
CN117234333A (zh) Vr物体选择方法、装置、电子设备及可读存储介质
WO2024131405A1 (zh) 对象移动控制方法、装置、设备及介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant