KR102338836B1 - 가상 현실 시스템에서 가상 컨트롤러의 위치 및 방위 추적 - Google Patents

가상 현실 시스템에서 가상 컨트롤러의 위치 및 방위 추적 Download PDF

Info

Publication number
KR102338836B1
KR102338836B1 KR1020197032189A KR20197032189A KR102338836B1 KR 102338836 B1 KR102338836 B1 KR 102338836B1 KR 1020197032189 A KR1020197032189 A KR 1020197032189A KR 20197032189 A KR20197032189 A KR 20197032189A KR 102338836 B1 KR102338836 B1 KR 102338836B1
Authority
KR
South Korea
Prior art keywords
controller
virtual
joint
user
segment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020197032189A
Other languages
English (en)
Korean (ko)
Other versions
KR20190136047A (ko
Inventor
사만다 라자
마누엘 크리스티안 클레멘트
샤이니 니슈리
다니엘 스턴펠드
스테판 웰커
케빈 호로비츠
코렌틴 파투스
Original Assignee
구글 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 구글 엘엘씨 filed Critical 구글 엘엘씨
Publication of KR20190136047A publication Critical patent/KR20190136047A/ko
Application granted granted Critical
Publication of KR102338836B1 publication Critical patent/KR102338836B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0383—Signal control means within the pointing device
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Position Input By Displaying (AREA)
  • Processing Or Creating Images (AREA)
KR1020197032189A 2017-09-18 2018-09-17 가상 현실 시스템에서 가상 컨트롤러의 위치 및 방위 추적 Active KR102338836B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US15/708,040 2017-09-18
US15/708,040 US10386938B2 (en) 2017-09-18 2017-09-18 Tracking of location and orientation of a virtual controller in a virtual reality system
PCT/US2018/051361 WO2019055929A1 (en) 2017-09-18 2018-09-17 MONITORING THE LOCATION AND ORIENTATION OF A VIRTUAL CONTROL DEVICE IN A VIRTUAL REALITY SYSTEM

Publications (2)

Publication Number Publication Date
KR20190136047A KR20190136047A (ko) 2019-12-09
KR102338836B1 true KR102338836B1 (ko) 2021-12-13

Family

ID=63963384

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020197032189A Active KR102338836B1 (ko) 2017-09-18 2018-09-17 가상 현실 시스템에서 가상 컨트롤러의 위치 및 방위 추적

Country Status (6)

Country Link
US (1) US10386938B2 (enExample)
EP (1) EP3685248B1 (enExample)
JP (2) JP7030854B2 (enExample)
KR (1) KR102338836B1 (enExample)
CN (1) CN110603510B (enExample)
WO (1) WO2019055929A1 (enExample)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12042303B2 (en) * 2018-03-07 2024-07-23 Brown University System for facilitating speech-based communication for individuals unable to speak or write
US20190385372A1 (en) * 2018-06-15 2019-12-19 Microsoft Technology Licensing, Llc Positioning a virtual reality passthrough region at a known distance
US11126341B2 (en) * 2019-02-21 2021-09-21 Htc Corporation Object manipulating method, host device and computer readable storage medium
US11086392B1 (en) * 2019-04-09 2021-08-10 Facebook Technologies, Llc Devices, systems, and methods for virtual representation of user interface devices
US11373374B2 (en) * 2019-11-07 2022-06-28 Volvo Car Corporation Aligning the augmented reality or virtual reality world with the real world using natural position understanding
JP7589696B2 (ja) * 2020-01-17 2024-11-26 ソニーグループ株式会社 情報処理装置及び情報処理方法、コンピュータプログラム、並びに拡張現実感システム
US11435185B2 (en) * 2020-02-21 2022-09-06 Microsoft Technology Licensing, Llc Systems and methods for deep learning-based pedestrian dead reckoning for exteroceptive sensor-enabled devices
WO2022061114A1 (en) * 2020-09-17 2022-03-24 Bogie Inc. System and method for an interactive controller
CN113318435A (zh) * 2021-04-27 2021-08-31 青岛小鸟看看科技有限公司 手柄控制追踪器的控制方法、装置及头戴式显示设备
US11934569B2 (en) * 2021-09-24 2024-03-19 Apple Inc. Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
KR20230100472A (ko) 2021-12-28 2023-07-05 삼성전자주식회사 손의 관절에 관한 위치 정보를 획득하는 증강 현실 디바이스 및 그 동작 방법
JP7719010B2 (ja) * 2022-02-18 2025-08-05 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置およびデバイス位置推定方法
US20230419627A1 (en) * 2022-06-24 2023-12-28 Lowe's Companies, Inc. Object modeling based on properties and images of an object
CN120266080A (zh) * 2022-12-23 2025-07-04 创峰科技 限定虚拟边界的方法和系统
CN116585709A (zh) * 2023-06-06 2023-08-15 北京字跳网络技术有限公司 虚拟对象的运动控制方法、装置、电子设备及存储介质
KR20250087355A (ko) 2023-12-07 2025-06-16 가톨릭대학교 산학협력단 가상 환경에서 사용자 아바타를 통한 대화형 체험 서비스 제공 방법 및 장치
JP7663767B1 (ja) * 2024-09-27 2025-04-16 株式会社コロプラ プログラムおよび情報処理システム
JP7658021B1 (ja) * 2024-09-27 2025-04-07 株式会社コロプラ プログラムおよび情報処理システム

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001236520A (ja) * 2000-02-21 2001-08-31 Nippon Telegr & Teleph Corp <Ntt> 仮想空間における動作入力方法および装置およびその動作入力プログラムを記録した記録媒体および仮想空間システム
JP2017045443A (ja) * 2015-08-28 2017-03-02 株式会社タカラトミー 頭部装着型ディスプレイを備えた情報処理装置

Family Cites Families (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6104379A (en) * 1996-12-11 2000-08-15 Virtual Technologies, Inc. Forearm-supported exoskeleton hand-tracking device
US7472047B2 (en) * 1997-05-12 2008-12-30 Immersion Corporation System and method for constraining a graphical hand from penetrating simulated graphical objects
US6042555A (en) * 1997-05-12 2000-03-28 Virtual Technologies, Inc. Force-feedback interface device for the hand
US7324085B2 (en) 2002-01-25 2008-01-29 Autodesk, Inc. Techniques for pointing to locations within a volumetric display
US10936074B2 (en) 2003-11-20 2021-03-02 National Institute Of Advanced Industrial Science And Technology Haptic information presentation system and method
US20160098095A1 (en) * 2004-01-30 2016-04-07 Electronic Scripting Products, Inc. Deriving Input from Six Degrees of Freedom Interfaces
US20080009771A1 (en) * 2006-03-29 2008-01-10 Joel Perry Exoskeleton
US9082213B2 (en) * 2007-11-07 2015-07-14 Canon Kabushiki Kaisha Image processing apparatus for combining real object and virtual object and processing method therefor
JP5287421B2 (ja) * 2009-03-27 2013-09-11 株式会社Ｊｖｃケンウッド 入力装置及びこれを用いた電子機器
US20110267356A1 (en) * 2010-04-29 2011-11-03 Rennuit Antoine F Lix Robert Animating a virtual object within a virtual world
US20110267357A1 (en) * 2010-04-29 2011-11-03 Rennuit Antoine Felix Robert Animating a virtual object within a virtual world
US9177409B2 (en) * 2010-04-29 2015-11-03 Naturalmotion Ltd Animating a virtual object within a virtual world
US8483877B2 (en) * 2010-09-03 2013-07-09 GM Global Technology Operations LLC Workspace safe operation of a force- or impedance-controlled robot
US9552673B2 (en) 2012-10-17 2017-01-24 Microsoft Technology Licensing, Llc Grasping virtual objects in augmented reality
KR101691633B1 (ko) * 2012-11-01 2017-01-09 아이캠, 엘엘씨 무선 손목 컴퓨팅과 3d 영상화, 매핑, 네트워킹 및 인터페이스를 위한 제어 장치 및 방법
US20140152558A1 (en) * 2012-11-30 2014-06-05 Tom Salter Direct hologram manipulation using imu
US9202313B2 (en) * 2013-01-21 2015-12-01 Microsoft Technology Licensing, Llc Virtual interaction with image projection
WO2014204330A1 (en) 2013-06-17 2014-12-24 3Divi Company Methods and systems for determining 6dof location and orientation of head-mounted display and associated user movements
US9437159B2 (en) * 2014-01-25 2016-09-06 Sony Interactive Entertainment America Llc Environmental interrupt in a head-mounted display and utilization of non field of view real estate
US9649558B2 (en) * 2014-03-14 2017-05-16 Sony Interactive Entertainment Inc. Gaming device with rotatably placed cameras
US10416760B2 (en) * 2014-07-25 2019-09-17 Microsoft Technology Licensing, Llc Gaze-based object placement within a virtual reality environment
KR102299364B1 (ko) * 2014-08-25 2021-09-07 삼성전자주식회사 웨어러블 디바이스의 센서가 측정하는 임피던스 값을 보정하는 방법 및 장치
US9690367B2 (en) 2014-12-10 2017-06-27 Sixense Entertainment, Inc. System and method for assisting a user in locating physical objects while the user is in a virtual reality environment
JP6391465B2 (ja) * 2014-12-26 2018-09-19 Kddi株式会社 ウェアラブル端末装置およびプログラム
US10725297B2 (en) * 2015-01-28 2020-07-28 CCP hf. Method and system for implementing a virtual representation of a physical environment using a virtual reality environment
US10180734B2 (en) * 2015-03-05 2019-01-15 Magic Leap, Inc. Systems and methods for augmented reality
US9898091B2 (en) * 2015-06-03 2018-02-20 Oculus Vr, Llc Virtual reality system with head-mounted display, camera and hand-held controllers
WO2016205182A1 (en) * 2015-06-15 2016-12-22 Survios, Inc. Systems and methods for immersive physical interaction with a virtual environment
US10095024B2 (en) * 2015-08-07 2018-10-09 Sony Interactive Entertainment Inc. Systems and methods for using a MEMS projector to determine an orientation of a photosensor of an HMD or another controller
US10010788B2 (en) * 2015-12-21 2018-07-03 Sony Interactive Entertainment Inc. Game controller with lights visible inside and outside the game controller
US10019131B2 (en) * 2016-05-10 2018-07-10 Google Llc Two-handed object manipulations in virtual reality
US10249090B2 (en) * 2016-06-09 2019-04-02 Microsoft Technology Licensing, Llc Robust optical disambiguation and tracking of two or more hand-held controllers with passive optical and inertial tracking
WO2018022657A1 (en) * 2016-07-25 2018-02-01 Ctrl-Labs Corporation System and method for measuring the movements of articulated rigid bodies
US10596700B2 (en) * 2016-09-16 2020-03-24 Carbon Robotics, Inc. System and calibration, registration, and training methods
US10134192B2 (en) * 2016-10-17 2018-11-20 Microsoft Technology Licensing, Llc Generating and displaying a computer generated image on a future pose of a real world object
US10657696B2 (en) * 2016-12-13 2020-05-19 DeepMotion, Inc. Virtual reality system using multiple force arrays for a solver
US10444865B2 (en) * 2017-05-01 2019-10-15 Google Llc Tracking of position and orientation of objects in virtual reality systems
US11054894B2 (en) * 2017-05-05 2021-07-06 Microsoft Technology Licensing, Llc Integrated mixed-input system

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001236520A (ja) * 2000-02-21 2001-08-31 Nippon Telegr & Teleph Corp <Ntt> 仮想空間における動作入力方法および装置およびその動作入力プログラムを記録した記録媒体および仮想空間システム
JP2017045443A (ja) * 2015-08-28 2017-03-02 株式会社タカラトミー 頭部装着型ディスプレイを備えた情報処理装置

Also Published As

Publication number Publication date
JP7030854B2 (ja) 2022-03-07
CN110603510A (zh) 2019-12-20
CN110603510B (zh) 2023-10-27
KR20190136047A (ko) 2019-12-09
WO2019055929A1 (en) 2019-03-21
US20190087019A1 (en) 2019-03-21
JP7382994B2 (ja) 2023-11-17
JP2022008987A (ja) 2022-01-14
EP3685248B1 (en) 2022-03-30
EP3685248A1 (en) 2020-07-29
US10386938B2 (en) 2019-08-20
JP2020529646A (ja) 2020-10-08

Similar Documents

Publication Publication Date Title
KR102338836B1 (ko) 가상 현실 시스템에서 가상 컨트롤러의 위치 및 방위 추적
US9367136B2 (en) Holographic object feedback
US10754497B2 (en) Two-handed object manipulations in virtual reality
CN107667328B (zh) 用于在增强和/或虚拟现实环境中跟踪手持设备的系统
CN109643159B (zh) 在增强和/或虚拟现实环境中利用六自由度控制器操纵虚拟对象
CN108073276B (zh) 增强和/或虚拟现实环境的拖拽虚拟元件
CN109074149B (zh) 用于增强或虚拟现实环境的头戴式参考系中的对象跟踪
JP7546116B2 (ja) 拡張現実のためのシステムおよび方法
CN111771180A (zh) 增强现实环境中对象的混合放置
US20180136744A1 (en) Input controller stabilization techniques for virtual reality systems
Wilk et al. Wearable human computer interface for control within immersive VAMR gaming environments using data glove and hand gestures
KR20250026324A (ko) 증강 현실을 사용하는 작업들의 로봇 학습
CN118700158A (zh) 一种机器人灵巧手的遥操作控制方法、装置、系统及介质
CN113496168A (zh) 手语数据采集方法、设备、存储介质
CN117234333A (zh) Vr物体选择方法、装置、电子设备及可读存储介质
CN116149474A (zh) 近眼显示设备的控制方法、装置及近眼显示设备
WO2024131405A1 (zh) 对象移动控制方法、装置、设备及介质
WO2023021757A1 (ja) 情報処理装置、情報処理方法、及びプログラム
Tecchia et al. Addressing the problem of Interaction in fully Immersive Virtual Environments: from raw sensor data to effective devices

Legal Events

Date Code Title Description
A201 Request for examination
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5