CN107850953B - 用于在虚拟现实环境中引导用户的感官反馈系统和方法 - Google Patents

用于在虚拟现实环境中引导用户的感官反馈系统和方法 Download PDF

Info

Publication number
CN107850953B
CN107850953B CN201580072357.3A CN201580072357A CN107850953B CN 107850953 B CN107850953 B CN 107850953B CN 201580072357 A CN201580072357 A CN 201580072357A CN 107850953 B CN107850953 B CN 107850953B
Authority
CN
China
Prior art keywords
user
obstacles
alert
relative
location
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201580072357.3A
Other languages
English (en)
Chinese (zh)
Other versions
CN107850953A (zh
Inventor
D·索耶
K·波德维尔
K·巴奈特
T·雷德福德
A·雷拜
E·里奇韦
A·C·弗拉霍斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Valve Corp
Original Assignee
Valve Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Valve Corp filed Critical Valve Corp
Publication of CN107850953A publication Critical patent/CN107850953A/zh
Application granted granted Critical
Publication of CN107850953B publication Critical patent/CN107850953B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/16—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G08—SIGNALLING
    • G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B5/00—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied
    • G08B5/22—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied using electric transmission; using electromagnetic transmission
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0149—Head-up displays characterised by mechanical features
    • G02B2027/0167—Emergency system, e.g. to prevent injuries

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Human Computer Interaction (AREA)
  • Electromagnetism (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
CN201580072357.3A 2014-11-05 2015-11-05 用于在虚拟现实环境中引导用户的感官反馈系统和方法 Active CN107850953B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201462075742P 2014-11-05 2014-11-05
US62/075,742 2014-11-05
US201562126695P 2015-03-01 2015-03-01
US62/126,695 2015-03-01
PCT/US2015/059329 WO2016073783A1 (en) 2014-11-05 2015-11-05 Sensory feedback systems and methods for guiding users in virtual reality environments

Publications (2)

Publication Number Publication Date
CN107850953A CN107850953A (zh) 2018-03-27
CN107850953B true CN107850953B (zh) 2021-08-31

Family

ID=55852614

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201580072357.3A Active CN107850953B (zh) 2014-11-05 2015-11-05 用于在虚拟现实环境中引导用户的感官反馈系统和方法

Country Status (7)

Country Link
US (2) US10241566B2 (ko)
EP (1) EP3215917B1 (ko)
JP (1) JP6539351B2 (ko)
KR (1) KR102667544B1 (ko)
CN (1) CN107850953B (ko)
HK (1) HK1250803A1 (ko)
WO (1) WO2016073783A1 (ko)

Families Citing this family (66)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9851786B2 (en) 2014-12-10 2017-12-26 Sixense Entertainment, Inc. System and method for assisting a user in remaining in a selected area while the user is in a virtual reality environment
US9870052B2 (en) * 2015-06-11 2018-01-16 Oculus Vr, Llc Hand-held controller with pressure-sensing switch for virtual-reality systems
US10685211B2 (en) 2015-08-04 2020-06-16 Sony Interactive Entertainment Inc. Head-mounted display, display control method, and program
JP6742760B2 (ja) * 2016-02-29 2020-08-19 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
US10486061B2 (en) 2016-03-25 2019-11-26 Zero Latency Pty Ltd. Interference damping for continuous game play
US10421012B2 (en) 2016-03-25 2019-09-24 Zero Latency PTY LTD System and method for tracking using multiple slave servers and a master server
US10717001B2 (en) 2016-03-25 2020-07-21 Zero Latency PTY LTD System and method for saving tracked data in the game server for replay, review and training
US9916496B2 (en) 2016-03-25 2018-03-13 Zero Latency PTY LTD Systems and methods for operating a virtual reality environment using colored marker lights attached to game objects
US10071306B2 (en) 2016-03-25 2018-09-11 Zero Latency PTY LTD System and method for determining orientation using tracking cameras and inertial measurements
CA3019664A1 (en) * 2016-04-12 2017-10-19 R-Stor Inc. Method and apparatus for presenting imagery within a virtualized environment
CN108633307B (zh) * 2016-05-17 2021-08-31 谷歌有限责任公司 在虚拟现实环境中投射与真实对象的接触的方法和装置
US10496156B2 (en) * 2016-05-17 2019-12-03 Google Llc Techniques to change location of objects in a virtual/augmented reality system
US10650591B1 (en) 2016-05-24 2020-05-12 Out of Sight Vision Systems LLC Collision avoidance system for head mounted display utilized in room scale virtual reality system
US10981060B1 (en) 2016-05-24 2021-04-20 Out of Sight Vision Systems LLC Collision avoidance system for room scale virtual reality system
EP3264801B1 (en) * 2016-06-30 2019-10-02 Nokia Technologies Oy Providing audio signals in a virtual environment
US10751609B2 (en) 2016-08-12 2020-08-25 Zero Latency PTY LTD Mapping arena movements into a 3-D virtual world
EP3301544A1 (en) * 2016-09-30 2018-04-04 Alcatel Lucent System and method for controlling an altered-reality application
CN106597373B (zh) * 2016-10-21 2019-05-28 上海拆名晃信息科技有限公司 一种虚拟现实定位系统、基于该系统的定位方法及装置
US10979721B2 (en) 2016-11-17 2021-04-13 Dolby Laboratories Licensing Corporation Predicting and verifying regions of interest selections
WO2018096599A1 (en) * 2016-11-22 2018-05-31 Sony Mobile Communications Inc. Environment-aware monitoring systems, methods, and computer program products for immersive environments
US10451439B2 (en) * 2016-12-22 2019-10-22 Microsoft Technology Licensing, Llc Dynamic transmitter power control for magnetic tracker
US10204455B2 (en) * 2016-12-31 2019-02-12 Intel Corporation Collision prevention for virtual reality systems
EP3529686A4 (en) 2017-01-13 2019-09-25 Samsung Electronics Co., Ltd. APPARATUS AND METHOD FOR PROVIDING GUIDANCE IN A VIRTUAL ENVIRONMENT
WO2018152690A1 (zh) * 2017-02-22 2018-08-30 深圳市卓梦科技有限责任公司 一种探测障碍物的专利信息推送方法以及vr头盔
WO2018152689A1 (zh) * 2017-02-22 2018-08-30 深圳市卓梦科技有限责任公司 一种探测障碍物技术的数据采集方法以及vr头盔
WO2018173399A1 (ja) * 2017-03-21 2018-09-27 ソニー株式会社 情報処理装置、情報処理方法、およびプログラム
EP3602496A4 (en) * 2017-04-21 2020-11-04 Hewlett-Packard Development Company, L.P. PROOF PROOF FOR VIRTUAL REALITY
EP3642693A4 (en) * 2017-06-21 2021-01-13 Hewlett-Packard Development Company, L.P. SENSORY FEEDBACK
US10423241B1 (en) 2017-07-31 2019-09-24 Amazon Technologies, Inc. Defining operating areas for virtual reality systems using sensor-equipped operating surfaces
US20190033989A1 (en) * 2017-07-31 2019-01-31 Google Inc. Virtual reality environment boundaries using depth sensors
US10803663B2 (en) * 2017-08-02 2020-10-13 Google Llc Depth sensor aided estimation of virtual reality environment boundaries
US20190094955A1 (en) * 2017-09-27 2019-03-28 Apple Inc. Range finding and accessory tracking for head-mounted display systems
CN111279292B (zh) * 2017-09-29 2022-06-14 苹果公司 检测物理边界
DE102017218215A1 (de) 2017-10-12 2019-04-18 Audi Ag Verfahren zum Betreiben einer am Kopf tragbaren elektronischen Anzeigeeinrichtung und Anzeigesystem zum Anzeigen eines virtuellen Inhalts
US20190139307A1 (en) * 2017-11-09 2019-05-09 Motorola Mobility Llc Modifying a Simulated Reality Display Based on Object Detection
EP3493026A1 (en) 2017-11-29 2019-06-05 Thomson Licensing A virtual reality external event processing method, corresponding devices and computer program
US10832477B2 (en) 2017-11-30 2020-11-10 International Business Machines Corporation Modifying virtual reality boundaries based on usage
EP3714318B1 (en) 2018-01-18 2023-08-30 Valve Corporation Position tracking system for head-mounted displays that includes sensor integrated circuits
US10983589B2 (en) * 2018-01-22 2021-04-20 MassVR, LLC Systems and methods for collision avoidance in virtual environments
US10726765B2 (en) 2018-02-15 2020-07-28 Valve Corporation Using tracking of display device to control image display
US10902680B2 (en) * 2018-04-03 2021-01-26 Saeed Eslami Augmented reality application system and method
US10554886B2 (en) * 2018-05-18 2020-02-04 Valve Corporation Power management for optical position tracking devices
WO2019231463A1 (en) * 2018-06-01 2019-12-05 Hewlett-Packard Development Company, L.P. Boundary maps for virtual reality systems
WO2019245543A1 (en) 2018-06-20 2019-12-26 Hewlett-Packard Development Company, L.P. Alerts of mixed reality devices
WO2019245550A1 (en) 2018-06-20 2019-12-26 Hewlett-Packard Development Company, L.P. Alerts of mixed reality devices
US10607367B2 (en) 2018-06-26 2020-03-31 International Business Machines Corporation Methods and systems for managing virtual reality sessions
US11100713B2 (en) 2018-08-17 2021-08-24 Disney Enterprises, Inc. System and method for aligning virtual objects on peripheral devices in low-cost augmented reality/virtual reality slip-in systems
US10901081B2 (en) 2018-10-02 2021-01-26 International Business Machines Corporation Virtual reality safety
US10776954B2 (en) 2018-10-08 2020-09-15 Microsoft Technology Licensing, Llc Real-world anchor in a virtual-reality environment
US11244483B2 (en) * 2018-10-31 2022-02-08 Facebook Technologies, Llc Systems and methods for modifying a safety boundary for virtual reality systems
US10928898B2 (en) 2019-01-03 2021-02-23 International Business Machines Corporation Augmented reality safety
KR102286987B1 (ko) * 2019-01-18 2021-08-05 경희대학교 산학협력단 가상현실 콘텐츠를 체험하는 사용자의 체험 공간 활용도 향상 방법 및 장치
US10885710B2 (en) 2019-03-14 2021-01-05 Microsoft Technology Licensing, Llc Reality-guided roaming in virtual reality
US11361513B2 (en) 2019-04-23 2022-06-14 Valve Corporation Head-mounted display with pass-through imaging
US11474610B2 (en) * 2019-05-20 2022-10-18 Meta Platforms Technologies, Llc Systems and methods for generating dynamic obstacle collision warnings for head-mounted displays
KR102614496B1 (ko) * 2019-08-09 2023-12-15 엘지전자 주식회사 Xr 디바이스 및 그 제어 방법
US10976805B2 (en) 2019-08-13 2021-04-13 International Business Machines Corporation Controlling the provision of a warning in a virtual environment using a virtual reality system
US11164383B2 (en) * 2019-08-30 2021-11-02 Lg Electronics Inc. AR device and method for controlling the same
US11842449B2 (en) 2019-09-26 2023-12-12 Apple Inc. Presenting an environment based on user movement
US11126850B1 (en) * 2020-04-09 2021-09-21 Facebook Technologies, Llc Systems and methods for detecting objects within the boundary of a defined space while in artificial reality
US11507246B2 (en) * 2020-10-07 2022-11-22 Htc Corporation Method for dynamically showing virtual boundary, electronic device and computer readable storage medium thereof
US11232644B1 (en) 2020-12-31 2022-01-25 Facebook Technologies, Llc Systems and methods for providing spatial awareness in virtual reality
WO2022196069A1 (ja) * 2021-03-15 2022-09-22 ソニーグループ株式会社 情報処理装置、情報処理方法、及び、プログラム
US11776166B2 (en) * 2021-10-08 2023-10-03 Sony Interactive Entertainment LLC Discrimination between virtual objects and real objects in a mixed reality scene
WO2024079832A1 (ja) * 2022-10-13 2024-04-18 三菱電機株式会社 インタフェース装置
CN115877578B (zh) * 2023-03-08 2023-05-16 济南科明数码技术股份有限公司 一种便于vr虚拟课堂教学的指令发信装置

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102099767A (zh) * 2008-07-15 2011-06-15 伊梅森公司 用于基于物理的触觉消息发送的系统和方法
WO2012176201A1 (en) * 2011-06-22 2012-12-27 Elbit Systems Ltd. Helmet mounted display system adjustable for bright ambient light conditions
CN103480154A (zh) * 2012-06-12 2014-01-01 索尼电脑娱乐公司 障碍物规避装置及障碍物规避方法
CN103761085A (zh) * 2013-12-18 2014-04-30 微软公司 混合现实全息对象开发
CN103975268A (zh) * 2011-10-07 2014-08-06 谷歌公司 具有附近物体响应的可穿戴计算机

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2301216A (en) * 1995-05-25 1996-11-27 Philips Electronics Uk Ltd Display headset
EP0750238B1 (en) * 1995-06-20 2000-03-01 Honeywell Inc. Integrated ground collision avoidance system
US6581546B1 (en) * 2002-02-14 2003-06-24 Waters Instruments, Inc. Animal containment system having a dynamically changing perimeter
JP4393169B2 (ja) * 2003-12-04 2010-01-06 キヤノン株式会社 複合現実感提示方法および装置
US7403101B2 (en) * 2005-02-09 2008-07-22 General Motors Corporation Collision avoidance of unattended vehicles
JP4642538B2 (ja) 2005-04-20 2011-03-02 キヤノン株式会社 画像処理方法および画像処理装置
US7741961B1 (en) * 2006-09-29 2010-06-22 Canesta, Inc. Enhanced obstacle detection and tracking for three-dimensional imaging systems used in motor vehicles
US9891435B2 (en) 2006-11-02 2018-02-13 Sensics, Inc. Apparatus, systems and methods for providing motion tracking using a personal viewing device
US8049644B1 (en) * 2007-04-17 2011-11-01 Rcokwell Collins, Inc. Method for TAWS depiction on SVS perspective displays
US20100156906A1 (en) * 2008-12-19 2010-06-24 David Montgomery Shot generation from previsualization of a physical environment
US8351894B2 (en) * 2009-02-27 2013-01-08 Research In Motion Limited Mobile wireless communications device with orientation sensing and related methods
JP2012155655A (ja) 2011-01-28 2012-08-16 Sony Corp 情報処理装置、報知方法及びプログラム
JP5691568B2 (ja) 2011-01-28 2015-04-01 ソニー株式会社 情報処理装置、報知方法及びプログラム
US20130083007A1 (en) * 2011-09-30 2013-04-04 Kevin A. Geisner Changing experience using personal a/v system
US9498720B2 (en) * 2011-09-30 2016-11-22 Microsoft Technology Licensing, Llc Sharing games using personal audio/visual apparatus
GB2501770B (en) * 2012-05-04 2016-03-16 Litonics Ltd Lighting device
CN102722249B (zh) * 2012-06-05 2016-03-30 上海鼎为电子科技（集团）有限公司 操控方法、操控装置及电子装置
EP2728311B1 (en) * 2012-10-30 2017-08-09 Elektrobit Automotive GmbH Technique for determining location data from a database
JP6079239B2 (ja) * 2013-01-04 2017-02-15 株式会社Ｊｖｃケンウッド 画像表示装置
US9395543B2 (en) * 2013-01-12 2016-07-19 Microsoft Technology Licensing, Llc Wearable behavior-based vision system
US9393870B2 (en) * 2013-03-15 2016-07-19 Honda Motor Co., Ltd. Volumetric heads-up display with dynamic focal plane
JP6094399B2 (ja) * 2013-06-24 2017-03-15 株式会社デンソー ヘッドアップディスプレイ、及びプログラム
JP2015087443A (ja) * 2013-10-29 2015-05-07 セイコーエプソン株式会社 光スキャナー、画像表示装置、ヘッドマウントディスプレイおよびヘッドアップディスプレイ

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102099767A (zh) * 2008-07-15 2011-06-15 伊梅森公司 用于基于物理的触觉消息发送的系统和方法
WO2012176201A1 (en) * 2011-06-22 2012-12-27 Elbit Systems Ltd. Helmet mounted display system adjustable for bright ambient light conditions
CN103975268A (zh) * 2011-10-07 2014-08-06 谷歌公司 具有附近物体响应的可穿戴计算机
CN103480154A (zh) * 2012-06-12 2014-01-01 索尼电脑娱乐公司 障碍物规避装置及障碍物规避方法
CN103761085A (zh) * 2013-12-18 2014-04-30 微软公司 混合现实全息对象开发

Also Published As

Publication number Publication date
WO2016073783A1 (en) 2016-05-12
JP6539351B2 (ja) 2019-07-03
US20190212812A1 (en) 2019-07-11
EP3215917A1 (en) 2017-09-13
HK1250803A1 (zh) 2019-01-11
KR102667544B1 (ko) 2024-05-20
US10241566B2 (en) 2019-03-26
KR20170081225A (ko) 2017-07-11
CN107850953A (zh) 2018-03-27
EP3215917B1 (en) 2023-10-11
US11334145B2 (en) 2022-05-17
US20160124502A1 (en) 2016-05-05
JP2017535901A (ja) 2017-11-30
EP3215917A4 (en) 2018-05-23

Similar Documents

Publication Publication Date Title
CN107850953B (zh) 用于在虚拟现实环境中引导用户的感官反馈系统和方法
JP6979475B2 (ja) ヘッドマウントディスプレイ追跡
CN110536665B (zh) 使用虚拟回声定位来仿真空间感知
KR101877411B1 (ko) 헤드 마운트 디스플레이를 위한 예측적 트래킹에 기반한 인식
KR102235410B1 (ko) 머리-장착형 디스플레이에서의 메뉴 내비게이션
US20180088776A1 (en) Three Dimensional User Interface Effects On A Display
US9690367B2 (en) System and method for assisting a user in locating physical objects while the user is in a virtual reality environment
US20160171771A1 (en) System and Method for Assisting a User in Remaining in a Selected Area While the User is in a Virtual Reality Environment
WO2017115635A1 (ja) 情報処理方法及び情報処理プログラム
JP2023504992A (ja) 姿勢ベースの仮想空間構成
AU2016210882A1 (en) Method and system for receiving gesture input via virtual control objects
US11695908B2 (en) Information processing apparatus and information processing method
US9547412B1 (en) User interface configuration to avoid undesired movement effects
JP6332652B1 (ja) 表示制御装置、及びプログラム
KR20170120624A (ko) 가상 및 증강 현실 환경에서의 제어기 시각화
US11195320B2 (en) Feed-forward collision avoidance for artificial reality environments
CN110720228A (zh) 呈现速度的适应
US20230013860A1 (en) Methods and systems for selection of objects
WO2023196669A1 (en) Triggering field transitions for artificial reality objects
WO2024072594A1 (en) Mapping a real-world room for a shared artificial reality environment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1250803

Country of ref document: HK

GR01 Patent grant
GR01 Patent grant