EP2755113A3 - A system of providing feedback based on an augmented reality environment - Google Patents

A system of providing feedback based on an augmented reality environment Download PDF

Info

Publication number
EP2755113A3
EP2755113A3 EP14151258.2A EP14151258A EP2755113A3 EP 2755113 A3 EP2755113 A3 EP 2755113A3 EP 14151258 A EP14151258 A EP 14151258A EP 2755113 A3 EP2755113 A3 EP 2755113A3
Authority
EP
European Patent Office
Prior art keywords
augmented reality
reality environment
feedback based
providing feedback
control signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP14151258.2A
Other languages
German (de)
English (en)
French (fr)
Other versions
EP2755113A2 (en
Inventor
Robert Lacroix
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Immersion Corp
Original Assignee
Immersion Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Immersion Corp filed Critical Immersion Corp
Publication of EP2755113A2 publication Critical patent/EP2755113A2/en
Publication of EP2755113A3 publication Critical patent/EP2755113A3/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
EP14151258.2A 2013-01-15 2014-01-15 A system of providing feedback based on an augmented reality environment Ceased EP2755113A3 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13/741,826 US20140198130A1 (en) 2013-01-15 2013-01-15 Augmented reality user interface with haptic feedback

Publications (2)

Publication Number Publication Date
EP2755113A2 EP2755113A2 (en) 2014-07-16
EP2755113A3 true EP2755113A3 (en) 2016-12-28

Family

ID=49958279

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14151258.2A Ceased EP2755113A3 (en) 2013-01-15 2014-01-15 A system of providing feedback based on an augmented reality environment

Country Status (5)

Country Link
US (1) US20140198130A1 (zh)
EP (1) EP2755113A3 (zh)
JP (2) JP6271256B2 (zh)
KR (1) KR20140092267A (zh)
CN (2) CN110262666A (zh)

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106990811A (zh) 2008-07-15 2017-07-28 意美森公司 用于触觉消息传输的系统和方法
EP2754008A4 (en) * 2011-06-21 2015-04-22 Univ Northwestern TOUCHING INTERFACE DEVICE AND METHOD FOR USING CROSS-HOLLOWS ON HUMAN LIMBS
US9041647B2 (en) * 2013-03-15 2015-05-26 Immersion Corporation User interface device provided with surface haptic sensations
JP2015130168A (ja) * 2013-12-31 2015-07-16 イマージョン コーポレーションＩｍｍｅｒｓｉｏｎ Ｃｏｒｐｏｒａｔｉｏｎ 摩擦拡張制御、及び、タッチコントロールパネルのボタンを摩擦拡張制御部へと変換する方法
US9690370B2 (en) 2014-05-05 2017-06-27 Immersion Corporation Systems and methods for viewport-based augmented reality haptic effects
JP6711276B2 (ja) * 2014-10-31 2020-06-17 ソニー株式会社 電子機器およびフィードバック提供方法
JP2018503416A (ja) * 2014-11-18 2018-02-08 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． ユーザガイダンスシステム及び方法、拡張現実デバイスの使用
US9846484B2 (en) * 2014-12-04 2017-12-19 Immersion Corporation Systems and methods for controlling haptic signals
CN105739671A (zh) * 2014-12-08 2016-07-06 北京蚁视科技有限公司 一种振动反馈装置及含有该装置的近眼显示器
WO2016097841A2 (en) * 2014-12-16 2016-06-23 Quan Xiao Methods and apparatus for high intuitive human-computer interface and human centric wearable "hyper" user interface that could be cross-platform / cross-device and possibly with local feel-able/tangible feedback
US20160189427A1 (en) * 2014-12-31 2016-06-30 Immersion Corporation Systems and methods for generating haptically enhanced objects for augmented and virtual reality applications
US10921896B2 (en) 2015-03-16 2021-02-16 Facebook Technologies, Llc Device interaction in augmented reality
JP6834962B2 (ja) * 2015-09-08 2021-02-24 ソニー株式会社 情報処理装置、方法およびコンピュータプログラム
US9857874B2 (en) * 2015-11-03 2018-01-02 Chunghwa Picture Tubes, Ltd. Augmented reality system and augmented reality interaction method
WO2017127128A1 (en) * 2016-01-22 2017-07-27 Elwha Llc Feedback for enhanced situational awareness
US20210385299A1 (en) * 2016-01-25 2021-12-09 Hiscene Information Technology Co., Ltd Method and apparatus for augmented reality interaction and presentation
CN106997235B (zh) * 2016-01-25 2018-07-13 亮风台（上海）信息科技有限公司 用于实现增强现实交互和展示的方法、设备
DE102016113060A1 (de) 2016-07-15 2018-01-18 Beckhoff Automation Gmbh Verfahren zum Steuern eines Objekts
KR20180019270A (ko) * 2016-08-16 2018-02-26 (주)알비케이이엠디 증강현실 또는 가상현실 구현 기기와 연동되는 햅틱 디바이스
US10427039B2 (en) 2016-12-08 2019-10-01 Immersion Corporation Haptic surround functionality
US10019875B1 (en) * 2016-12-30 2018-07-10 Immersion Corporation Inertial haptic actuators having a cantilevered beam and a smart material
CN110582741B (zh) 2017-03-21 2024-04-02 交互数字Vc控股公司 用于增强现实中触觉交互检测和增强的方法和系统
EP3635520A4 (en) * 2017-06-08 2021-05-19 Honeywell International Inc. APPARATUS AND METHOD FOR RECORDING AND REPLAYING INTERACTIVE AUGMENTED / VIRTUAL REALITY CONTENT IN INDUSTRIAL AUTOMATION SYSTEMS AND OTHER SYSTEMS
CN109147001A (zh) * 2017-06-19 2019-01-04 亮风台（上海）信息科技有限公司 一种用于呈现虚拟指甲的方法与设备
KR102364678B1 (ko) * 2017-06-20 2022-02-18 엘지전자 주식회사 이동 단말기
CN107422942A (zh) * 2017-08-15 2017-12-01 吴金河 一种沉浸式体验的控制系统及方法
US20190155387A1 (en) * 2017-11-22 2019-05-23 Immersion Corporation Haptic Accessory Apparatus
JP6453501B1 (ja) * 2018-02-01 2019-01-16 株式会社Ｃｙｇａｍｅｓ 複合現実システム、プログラム、方法、及び携帯端末装置
US10572016B2 (en) * 2018-03-06 2020-02-25 Microsoft Technology Licensing, Llc Spatialized haptic device force feedback
US20190324538A1 (en) * 2018-04-20 2019-10-24 Immersion Corporation Haptic-enabled wearable device for generating a haptic effect in an immersive reality environment
US11270597B2 (en) * 2018-05-01 2022-03-08 Codescribe Llc Simulated reality technologies for enhanced medical protocol training
US11875693B2 (en) 2018-05-01 2024-01-16 Codescribe Corporation Simulated reality technologies for enhanced medical protocol training
EP3599538B1 (en) * 2018-07-24 2023-07-19 Nokia Technologies Oy Method and apparatus for adding interactive objects to a virtual reality environment
CN110928472B (zh) * 2018-09-19 2023-05-05 阿里巴巴集团控股有限公司 物品处理方法、装置及电子设备
KR20200033388A (ko) * 2018-09-20 2020-03-30 (주)리얼감 포스 피드백 방법 및 시스템, 기계로 읽을 수 있는 저장 매체
CN109917911B (zh) * 2019-02-20 2021-12-28 西北工业大学 一种基于信息物理交互的振动触觉反馈装置设计方法
US10852827B1 (en) 2019-03-25 2020-12-01 Facebook Technologies, Llc Tactile simulation of initial contact with virtual objects
CN110442233B (zh) * 2019-06-18 2020-12-04 中国人民解放军军事科学院国防科技创新研究院 一种基于手势交互的增强现实键鼠系统
KR102467436B1 (ko) * 2020-11-13 2022-11-16 (주)에이트원 산업 안전 가상 훈련 시스템 및 그 방법

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060017654A1 (en) * 2004-07-23 2006-01-26 Romo Justin R Virtual reality interactivity system and method
EP1916592A2 (en) * 2006-10-23 2008-04-30 Canon Kabushiki Kaisha Haptic feedback apparatus and method
EP2034390A2 (en) * 2007-09-10 2009-03-11 Canon Kabushiki Kaisha Information-processing apparatus and information-processing method

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US1758156A (en) * 1928-12-27 1930-05-13 Frederick W Huber Method and means for cementing oil wells
JP2002082751A (ja) * 2000-09-08 2002-03-22 Mitsubishi Electric Corp 仮想空間とのインタラクション装置およびこれを応用した仮想空間システム
KR20090096559A (ko) * 2001-11-01 2009-09-10 임머숀 코퍼레이션 촉각을 제공하기 위한 방법 및 장치
JP2003316493A (ja) * 2002-04-19 2003-11-07 Seiko Epson Corp 触覚提示装置
SE0203908D0 (sv) * 2002-12-30 2002-12-30 Abb Research Ltd An augmented reality system and method
WO2006081198A2 (en) * 2005-01-25 2006-08-03 The Board Of Trustees Of The University Of Illinois Compact haptic and augmented virtual reality system
KR20100072198A (ko) * 2007-08-19 2010-06-30 링보우 리미티드 반지형 장치와 그 사용방법
KR100927009B1 (ko) * 2008-02-04 2009-11-16 광주과학기술원 증강 현실에서의 햅틱 상호 작용 방법 및 그 시스템
US20090289955A1 (en) * 2008-05-22 2009-11-26 Yahoo! Inc. Reality overlay device
JP5344388B2 (ja) * 2008-07-10 2013-11-20 学校法人立命館 操作システム
US8747116B2 (en) * 2008-08-21 2014-06-10 Lincoln Global, Inc. System and method providing arc welding training in a real-time simulated virtual reality environment using real-time weld puddle feedback
WO2010051089A1 (en) * 2008-10-27 2010-05-06 Sony Computer Entertainment Inc Control device for communicating visual information
US9978288B2 (en) * 2009-02-13 2018-05-22 University Of Florida Research Foundation, Inc. Communication and skills training using interactive virtual humans
US8009022B2 (en) * 2009-05-29 2011-08-30 Microsoft Corporation Systems and methods for immersive interaction with virtual objects
US8542105B2 (en) * 2009-11-24 2013-09-24 Immersion Corporation Handheld computer interface with haptic feedback
US8633916B2 (en) * 2009-12-10 2014-01-21 Apple, Inc. Touch pad with force sensors and actuator feedback
CN101819462B (zh) * 2010-03-12 2011-07-20 东南大学 基于力/触觉交互设备的图像纹理的力触觉再现系统
US20110310227A1 (en) * 2010-06-17 2011-12-22 Qualcomm Incorporated Mobile device based content mapping for augmented reality environment
CA3035118C (en) * 2011-05-06 2022-01-04 Magic Leap, Inc. Massive simultaneous remote digital presence world
US20130002425A1 (en) * 2011-07-01 2013-01-03 General Electric Company Augmented reality excessive noise display and warning system
US20130265300A1 (en) * 2011-07-03 2013-10-10 Neorai Vardi Computer device in form of wearable glasses and user interface thereof
RU2621633C2 (ru) * 2011-10-28 2017-06-06 Мэджик Лип, Инк. Система и способ для дополненной и виртуальной реальности

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060017654A1 (en) * 2004-07-23 2006-01-26 Romo Justin R Virtual reality interactivity system and method
EP1916592A2 (en) * 2006-10-23 2008-04-30 Canon Kabushiki Kaisha Haptic feedback apparatus and method
EP2034390A2 (en) * 2007-09-10 2009-03-11 Canon Kabushiki Kaisha Information-processing apparatus and information-processing method

Also Published As

Publication number Publication date
JP6713445B2 (ja) 2020-06-24
EP2755113A2 (en) 2014-07-16
JP2018073433A (ja) 2018-05-10
US20140198130A1 (en) 2014-07-17
JP6271256B2 (ja) 2018-01-31
CN103970265B (zh) 2019-08-23
CN103970265A (zh) 2014-08-06
CN110262666A (zh) 2019-09-20
JP2014139784A (ja) 2014-07-31
KR20140092267A (ko) 2014-07-23

Similar Documents

Publication Publication Date Title
EP2755113A3 (en) A system of providing feedback based on an augmented reality environment
EP2778854A3 (en) Wearable device and augmented reality device
EP2778848A3 (en) System, method and electronic device for providing a haptic effect to a user
NZ746640A (en) Interactions with 3d virtual objects using poses and multiple-dof controllers
EP3258347A3 (en) Systems and methods for providing haptic feedback via a case
AU2017332777A8 (en) Dynamic function row customization
GB2569438B (en) Surgical imaging sensor and display unit, and surgical navigation system associated therewith
EP2846225A3 (en) Systems and methods for visual processing of spectrograms to generate haptic effects
EP2693284A3 (en) Systems and method for haptic remote control gaming
EP2779672A3 (en) Systems and methods for enhanced television interaction
GB2564764A (en) Sonar sensor fusion and model based virtual and augmented reality systems and methods
EP4253911A3 (en) Inspection vehicle control device, control method, and computer program
EP2846229A3 (en) Systems and methods for generating haptic effects associated with audio signals
EP2925016A3 (en) Microphone device and microphone unit
EP3547678A4 (en) IMAGING DEVICE, IMAGING SYSTEM AND DISPLAY SYSTEM
EP2793096A3 (en) Flight system for an aircraft having an autoland system
EP2703952A3 (en) System for haptically representing sensor input
EP3394693A4 (en) DIAGNOSTIC DEVICE, COMPUTER PROGRAM AND DIAGNOSTIC SYSTEM
EP3028750A3 (en) Systems and methods for controlling haptic signals
EP2778845A3 (en) Systems and methods for haptics in vibrating environments and devices
EP2837993A3 (en) Systems and methods for haptic fiddling
EP3128396A4 (en) Tactile sense presentation device, signal generating device, tactile sense presentation system, and tactile sense presentation method
EP3889728A3 (en) Selective processing of sensor data
EP3007038A3 (en) Interaction with three-dimensional video
WO2015047453A3 (en) Interactions of virtual objects with surfaces

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140115

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: IMMERSION CORPORATION

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/01 20060101AFI20161123BHEP

R17P Request for examination filed (corrected)

Effective date: 20170628

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17Q First examination report despatched

Effective date: 20190207

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20200829