US11294467B2 - Systems and methods for integrating environmental haptics in virtual reality - Google Patents
Systems and methods for integrating environmental haptics in virtual reality Download PDFInfo
- Publication number
- US11294467B2 US11294467B2 US16/224,162 US201816224162A US11294467B2 US 11294467 B2 US11294467 B2 US 11294467B2 US 201816224162 A US201816224162 A US 201816224162A US 11294467 B2 US11294467 B2 US 11294467B2
- Authority
- US
- United States
- Prior art keywords
- haptic effect
- sensor
- haptic
- virtual reality
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000000694 effects Effects 0.000 claims abstract description 288
- 230000004048 modification Effects 0.000 abstract description 48
- 238000006011 modification reaction Methods 0.000 abstract description 48
- 238000004088 simulation Methods 0.000 description 76
- 238000000034 method Methods 0.000 description 20
- 239000000203 mixture Substances 0.000 description 16
- 230000015654 memory Effects 0.000 description 10
- 230000004044 response Effects 0.000 description 8
- 230000035807 sensation Effects 0.000 description 8
- 241000282472 Canis lupus familiaris Species 0.000 description 6
- 238000004891 communication Methods 0.000 description 6
- 238000001514 detection method Methods 0.000 description 6
- 230000003287 optical Effects 0.000 description 6
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 6
- 241000251468 Actinopterygii Species 0.000 description 4
- 230000001680 brushing Effects 0.000 description 4
- 230000000875 corresponding Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000006073 displacement reaction Methods 0.000 description 4
- 239000011521 glass Substances 0.000 description 4
- 230000003155 kinesthetic Effects 0.000 description 4
- 239000011435 rock Substances 0.000 description 4
- 230000002104 routine Effects 0.000 description 4
- 230000001360 synchronised Effects 0.000 description 4
- 230000001960 triggered Effects 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 229920001746 Electroactive polymer Polymers 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 2
- 239000010426 asphalt Substances 0.000 description 2
- 230000003190 augmentative Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000001413 cellular Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000004880 explosion Methods 0.000 description 2
- 238000010304 firing Methods 0.000 description 2
- 238000007654 immersion Methods 0.000 description 2
- 230000000873 masking Effects 0.000 description 2
- 230000002040 relaxant effect Effects 0.000 description 2
- 238000005096 rolling process Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- 229910001285 shape-memory alloy Inorganic materials 0.000 description 2
- 230000001340 slower Effects 0.000 description 2
- 238000004642 transportation engineering Methods 0.000 description 2
- 239000002023 wood Substances 0.000 description 2
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Abstract
Description
Claims (13)
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/224,162 US11294467B2 (en) | 2018-12-18 | 2018-12-18 | Systems and methods for integrating environmental haptics in virtual reality |
KR1020217021862A KR20210104092A (en) | 2018-12-18 | 2019-12-16 | Systems and Methods for Incorporating Environmental Haptics in Virtual Reality |
EP19836883.9A EP3899698A1 (en) | 2018-12-18 | 2019-12-16 | Systems and methods for integrating environmental haptics in virtual reality |
JP2021533613A JP2022512479A (en) | 2018-12-18 | 2019-12-16 | Systems and methods for integrating environmental tactile sensations into virtual reality |
PCT/US2019/066464 WO2020131670A1 (en) | 2018-12-18 | 2019-12-16 | Systems and methods for integrating environmental haptics in virtual reality |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/224,162 US11294467B2 (en) | 2018-12-18 | 2018-12-18 | Systems and methods for integrating environmental haptics in virtual reality |
Publications (2)
Publication Number | Publication Date |
---|---|
US20200192479A1 US20200192479A1 (en) | 2020-06-18 |
US11294467B2 true US11294467B2 (en) | 2022-04-05 |
Family
ID=69167913
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/224,162 Active US11294467B2 (en) | 2018-12-18 | 2018-12-18 | Systems and methods for integrating environmental haptics in virtual reality |
Country Status (5)
Country | Link |
---|---|
US (1) | US11294467B2 (en) |
EP (1) | EP3899698A1 (en) |
JP (1) | JP2022512479A (en) |
KR (1) | KR20210104092A (en) |
WO (1) | WO2020131670A1 (en) |
Citations (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20110043537A1 (en) * | 2009-08-20 | 2011-02-24 | University Of Washington | Visual distortion in a virtual environment to alter or guide path movement |
US20110187651A1 (en) | 2010-02-03 | 2011-08-04 | Honeywell International Inc. | Touch screen having adaptive input parameter |
EP2778845A2 (en) | 2013-03-11 | 2014-09-17 | Immersion Corporation | Systems and methods for haptics in vibrating environments and devices |
EP2778850A1 (en) | 2013-03-15 | 2014-09-17 | Immersion Corporation | Systems and methods for parameter modification of haptic effects |
US8876688B2 (en) * | 2008-04-24 | 2014-11-04 | The Invention Science Fund I, Llc | Combination treatment modification methods and systems |
EP2821912A1 (en) | 2013-07-02 | 2015-01-07 | Immersion Corporation | Systems and methods for perceptual normalization of haptic effects |
US20150022443A1 (en) * | 2013-07-18 | 2015-01-22 | Technische Universität Dresden | Process and Apparatus for Haptic Interaction with Visually Presented Data |
US20150268724A1 (en) * | 2014-03-21 | 2015-09-24 | Immersion Corporation | Systems and Methods for Haptically-Enabled Curved Devices |
US20150331576A1 (en) * | 2014-05-14 | 2015-11-19 | Purdue Research Foundation | Manipulating virtual environment using non-instrumented physical object |
US20150355711A1 (en) * | 2014-06-09 | 2015-12-10 | Immersion Corporation | Programmable haptic devices and methods for modifying haptic strength based on perspective and/or proximity |
US20160189493A1 (en) * | 2014-12-29 | 2016-06-30 | Immersion Corporation | Virtual sensor in a virtual environment |
US20170186244A1 (en) * | 2015-12-24 | 2017-06-29 | Dassault Systemes | 3d object localization with quantization |
US20170287223A1 (en) | 2016-03-31 | 2017-10-05 | Lenovo (Beijing) Limited | Information processing method and electronic device |
US20180039302A1 (en) * | 2016-08-02 | 2018-02-08 | Immersion Corporation | Systems and methods for deformation and haptic effects |
US20180040163A1 (en) * | 2016-08-05 | 2018-02-08 | Uber Technologies, Inc. | Virtual reality experience for a vehicle |
US20180081426A1 (en) | 2016-09-21 | 2018-03-22 | Apple Inc. | Relative intertial measurement system |
WO2018057980A1 (en) | 2016-09-23 | 2018-03-29 | Apple Inc. | Immersive virtual display |
US10031580B2 (en) * | 2016-01-13 | 2018-07-24 | Immersion Corporation | Systems and methods for haptically-enabled neural interfaces |
US10146308B2 (en) * | 2014-10-14 | 2018-12-04 | Immersion Corporation | Systems and methods for impedance coupling for haptic devices |
US20180357836A1 (en) | 2016-02-18 | 2018-12-13 | National University Corporation Nagoya University | Virtual space display system |
US10180734B2 (en) * | 2015-03-05 | 2019-01-15 | Magic Leap, Inc. | Systems and methods for augmented reality |
US10269162B2 (en) * | 2016-11-14 | 2019-04-23 | Envisico LLC | System and method for modeling object movement |
US10504295B2 (en) * | 2016-09-27 | 2019-12-10 | Duke University | Systems and methods for using sensing of real object position, trajectory, or attitude to enable user interaction with a virtual object |
US20200117898A1 (en) * | 2018-10-10 | 2020-04-16 | Midea Group Co., Ltd. | Method and system for providing remote robotic control |
-
2018
- 2018-12-18 US US16/224,162 patent/US11294467B2/en active Active
-
2019
- 2019-12-16 JP JP2021533613A patent/JP2022512479A/en active Pending
- 2019-12-16 EP EP19836883.9A patent/EP3899698A1/en not_active Withdrawn
- 2019-12-16 WO PCT/US2019/066464 patent/WO2020131670A1/en unknown
- 2019-12-16 KR KR1020217021862A patent/KR20210104092A/en unknown
Patent Citations (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8876688B2 (en) * | 2008-04-24 | 2014-11-04 | The Invention Science Fund I, Llc | Combination treatment modification methods and systems |
US20110043537A1 (en) * | 2009-08-20 | 2011-02-24 | University Of Washington | Visual distortion in a virtual environment to alter or guide path movement |
US20110187651A1 (en) | 2010-02-03 | 2011-08-04 | Honeywell International Inc. | Touch screen having adaptive input parameter |
EP2778845A2 (en) | 2013-03-11 | 2014-09-17 | Immersion Corporation | Systems and methods for haptics in vibrating environments and devices |
EP2778850A1 (en) | 2013-03-15 | 2014-09-17 | Immersion Corporation | Systems and methods for parameter modification of haptic effects |
EP2821912A1 (en) | 2013-07-02 | 2015-01-07 | Immersion Corporation | Systems and methods for perceptual normalization of haptic effects |
US20150022443A1 (en) * | 2013-07-18 | 2015-01-22 | Technische Universität Dresden | Process and Apparatus for Haptic Interaction with Visually Presented Data |
US20150268724A1 (en) * | 2014-03-21 | 2015-09-24 | Immersion Corporation | Systems and Methods for Haptically-Enabled Curved Devices |
US20150331576A1 (en) * | 2014-05-14 | 2015-11-19 | Purdue Research Foundation | Manipulating virtual environment using non-instrumented physical object |
US20150355711A1 (en) * | 2014-06-09 | 2015-12-10 | Immersion Corporation | Programmable haptic devices and methods for modifying haptic strength based on perspective and/or proximity |
US10146308B2 (en) * | 2014-10-14 | 2018-12-04 | Immersion Corporation | Systems and methods for impedance coupling for haptic devices |
US20160189493A1 (en) * | 2014-12-29 | 2016-06-30 | Immersion Corporation | Virtual sensor in a virtual environment |
US9478109B2 (en) * | 2014-12-29 | 2016-10-25 | Immersion Corporation | Virtual sensor in a virtual environment |
US10180734B2 (en) * | 2015-03-05 | 2019-01-15 | Magic Leap, Inc. | Systems and methods for augmented reality |
US20170186244A1 (en) * | 2015-12-24 | 2017-06-29 | Dassault Systemes | 3d object localization with quantization |
US10031580B2 (en) * | 2016-01-13 | 2018-07-24 | Immersion Corporation | Systems and methods for haptically-enabled neural interfaces |
US20180357836A1 (en) | 2016-02-18 | 2018-12-13 | National University Corporation Nagoya University | Virtual space display system |
US20170287223A1 (en) | 2016-03-31 | 2017-10-05 | Lenovo (Beijing) Limited | Information processing method and electronic device |
US20180039302A1 (en) * | 2016-08-02 | 2018-02-08 | Immersion Corporation | Systems and methods for deformation and haptic effects |
US20180040163A1 (en) * | 2016-08-05 | 2018-02-08 | Uber Technologies, Inc. | Virtual reality experience for a vehicle |
US20180081426A1 (en) | 2016-09-21 | 2018-03-22 | Apple Inc. | Relative intertial measurement system |
WO2018057980A1 (en) | 2016-09-23 | 2018-03-29 | Apple Inc. | Immersive virtual display |
US10504295B2 (en) * | 2016-09-27 | 2019-12-10 | Duke University | Systems and methods for using sensing of real object position, trajectory, or attitude to enable user interaction with a virtual object |
US10269162B2 (en) * | 2016-11-14 | 2019-04-23 | Envisico LLC | System and method for modeling object movement |
US20200117898A1 (en) * | 2018-10-10 | 2020-04-16 | Midea Group Co., Ltd. | Method and system for providing remote robotic control |
Non-Patent Citations (3)
Title |
---|
Castrol Limited, "Castrol EDGE Blurs Reality & Virtual Reality In ‘Virtual Drift’", 2015, video retrieved via internet at https://www.vrfocus.com/2015/05/castrol-edge-blurs-reality-virtual-reality-in-promotional-video-virtual-drift/. |
PCT Application No. PCT/US2019/066464 , International Search Report and Written Opinion, dated Mar. 25, 2020, 11 pages. |
Samsung Electronics America, Inc., Six Flags, "New Revolution Virtual Reality Coaster," retrieved via internet at https://www.sixflags.com/greatescape/attractions/vr/overview. |
Also Published As
Publication number | Publication date |
---|---|
KR20210104092A (en) | 2021-08-24 |
EP3899698A1 (en) | 2021-10-27 |
JP2022512479A (en) | 2022-02-04 |
WO2020131670A1 (en) | 2020-06-25 |
US20200192479A1 (en) | 2020-06-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7109408B2 (en) | Wide range simultaneous remote digital presentation world | |
US10311640B2 (en) | Method and apparatus for providing virtual space, and non-transitory computer readable data storage medium storing program causing computer to perform method | |
CN105094311B (en) | Systems and methods for viewport-based augmented reality haptic effects | |
US10583361B2 (en) | Incorporating and coordinating multiple home systems into a play experience | |
US20170220104A1 (en) | Combination gesture game mechanics using multiple devices | |
US10589176B2 (en) | Method of providing a virtual space, medium for causing a computer to execute the method, and system for providing a virtual space | |
JP6126273B1 (en) | Method for providing virtual space, program for causing computer to realize the method, and system for providing virtual space | |
JP6393387B1 (en) | Programs, computers, and methods for providing a virtual experience | |
US11294467B2 (en) | Systems and methods for integrating environmental haptics in virtual reality | |
WO2022004422A1 (en) | Information processing device, information processing method, and recording medium | |
JP6446150B1 (en) | Program, information processing apparatus, and method | |
JP6934383B2 (en) | A method for providing virtual space, a program for realizing the method on a computer, and a system for providing virtual space. | |
JP2019171077A (en) | Program, information processor, and method | |
JP6457680B1 (en) | Program, information processing apparatus, and method | |
JP6469915B1 (en) | Program, information processing apparatus, and method | |
JP6966246B2 (en) | An information processing method, a device, and a program for causing a computer to execute the information processing method. | |
JP2019170940A (en) | Program, information processor, and method | |
JP2019185723A (en) | Program, information processing device, and information processing method | |
JP2019179433A (en) | Program, information processing device, and information processing method | |
JP2019075091A (en) | Program for providing virtual experience, computer and method | |
JP2017220219A (en) | Method for providing virtual space, program for causing computer to achieve method, recording medium recording program, and system for providing virtual space |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: IMMERSION CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FOREST, SIMON;MOUSAKHANIAN, RAZMIK;WU, LIWEN;REEL/FRAME:049499/0934 Effective date: 20181218 |
|
STCB | Information on status: application discontinuation |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: FINAL REJECTION MAILED |
|
AS | Assignment |
Owner name: IMMERSION CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LEVESQUE, VINCENT;REEL/FRAME:055048/0900 Effective date: 20190621 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STCB | Information on status: application discontinuation |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |