EP3234741A4 - Verfahren, system und vorrichtung zur navigation in einer umgebung der virtuellen realität - Google Patents

Verfahren, system und vorrichtung zur navigation in einer umgebung der virtuellen realität Download PDF

Info

Publication number
EP3234741A4
EP3234741A4 EP15871243.0A EP15871243A EP3234741A4 EP 3234741 A4 EP3234741 A4 EP 3234741A4 EP 15871243 A EP15871243 A EP 15871243A EP 3234741 A4 EP3234741 A4 EP 3234741A4
Authority
EP
European Patent Office
Prior art keywords
navigating
virtual reality
reality environment
environment
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP15871243.0A
Other languages
English (en)
French (fr)
Other versions
EP3234741A1 (de
Inventor
Nadav Grossinger
Emil ALON
Iddo BAR DAVID
Efrat SOLODNIK
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Meta Platforms Technologies LLC
Original Assignee
Facebook Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Facebook Inc filed Critical Facebook Inc
Publication of EP3234741A1 publication Critical patent/EP3234741A1/de
Publication of EP3234741A4 publication Critical patent/EP3234741A4/de
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Position Input By Displaying (AREA)
EP15871243.0A 2014-12-18 2015-12-18 Verfahren, system und vorrichtung zur navigation in einer umgebung der virtuellen realität Ceased EP3234741A4 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201462093493P 2014-12-18 2014-12-18
PCT/US2015/066907 WO2016100931A1 (en) 2014-12-18 2015-12-18 Method, system and device for navigating in a virtual reality environment

Publications (2)

Publication Number Publication Date
EP3234741A1 EP3234741A1 (de) 2017-10-25
EP3234741A4 true EP3234741A4 (de) 2018-08-22

Family

ID=56127742

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15871243.0A Ceased EP3234741A4 (de) 2014-12-18 2015-12-18 Verfahren, system und vorrichtung zur navigation in einer umgebung der virtuellen realität

Country Status (6)

Country Link
US (2) US9659413B2 (de)
EP (1) EP3234741A4 (de)
JP (2) JP6554631B2 (de)
KR (4) KR20210097818A (de)
CN (2) CN107209561A (de)
WO (1) WO2016100931A1 (de)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101711619B1 (ko) * 2009-09-22 2017-03-02 페블스텍 리미티드 컴퓨터 장치의 원격 제어
JP6554631B2 (ja) * 2014-12-18 2019-08-07 フェイスブック・テクノロジーズ・リミテッド・ライアビリティ・カンパニーＦａｃｅｂｏｏｋ Ｔｅｃｈｎｏｌｏｇｉｅｓ， Ｌｌｃ 仮想現実環境においてナビゲートする方法、システム、および装置
US20170061700A1 (en) * 2015-02-13 2017-03-02 Julian Michael Urbach Intercommunication between a head mounted display and a real world object
JP5981591B1 (ja) * 2015-03-17 2016-08-31 株式会社コロプラ 没入型仮想空間でオブジェクト操作を制御するためのコンピュータ・プログラムおよびコンピュータ・システム
EP3106963B1 (de) * 2015-06-16 2019-07-24 Nokia Technologies Oy Vermittelte realität
JP6203346B1 (ja) * 2016-08-16 2017-09-27 株式会社コロプラ 仮想空間を提供する方法、プログラム、および記録媒体
US10650621B1 (en) 2016-09-13 2020-05-12 Iocurrents, Inc. Interfacing with a vehicular controller area network
RU2746686C2 (ru) 2016-11-25 2021-04-19 Сенсорикс Аг Носимая система отслеживания движения
US10055028B2 (en) * 2016-12-05 2018-08-21 Google Llc End of session detection in an augmented and/or virtual reality environment
CN106775245B (zh) * 2016-12-19 2020-02-14 传线网络科技（上海）有限公司 基于虚拟现实的用户属性设置方法及装置
US11157131B2 (en) 2017-02-24 2021-10-26 Vrad Inc. Virtual reality-based radiology practice apparatus and method
US11436811B2 (en) * 2017-04-25 2022-09-06 Microsoft Technology Licensing, Llc Container-based virtual camera rotation
US10417827B2 (en) * 2017-05-04 2019-09-17 Microsoft Technology Licensing, Llc Syndication of direct and indirect interactions in a computer-mediated reality environment
FR3069936B1 (fr) 2017-08-03 2019-09-27 Renault S.A.S Interaction tactile avec des ihm dans un environnement immersif
US11425350B2 (en) * 2018-03-08 2022-08-23 Virtualwindow Co., Ltd. Image display system
US11386604B2 (en) * 2018-09-27 2022-07-12 Apple Inc. Moving an avatar based on real-world data
US11410398B2 (en) 2018-11-21 2022-08-09 Hewlett-Packard Development Company, L.P. Augmenting live images of a scene for occlusion
CN110221690B (zh) * 2019-05-13 2022-01-04 Oppo广东移动通信有限公司 基于ar场景的手势交互方法及装置、存储介质、通信终端
CA3139465A1 (en) 2019-06-20 2020-12-24 Barrie A. Loberg Voice communication system within a mixed-reality environment
US11462000B2 (en) * 2019-08-26 2022-10-04 Apple Inc. Image-based detection of surfaces that provide specular reflections and reflection modification
KR102464437B1 (ko) 2022-05-04 2022-11-09 주식회사 엠펀치 기가 픽셀 미디어 객체 감상 및 거래를 제공하는 메타버스 기반 크로스 플랫폼 서비스 시스템

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006015236A2 (en) * 2004-07-28 2006-02-09 Intelligentek Corporation Audio-visual three-dimensional input/output
WO2013049248A2 (en) * 2011-09-26 2013-04-04 Osterhout Group, Inc. Video display modification based on sensor input for a see-through near-to-eye display
EP2733581A2 (de) * 2012-11-20 2014-05-21 Samsung Electronics Co., Ltd Benutzergesteneingabe in einer tragbaren elektronischen Vorrichtung mit nach außen schauendem Vorrichtungssensor
US20140160001A1 (en) * 2012-12-06 2014-06-12 Peter Tobias Kinnebrew Mixed reality presentation
US20140204002A1 (en) * 2013-01-21 2014-07-24 Rotem Bennet Virtual interaction with image projection
US20140225918A1 (en) * 2013-02-14 2014-08-14 Qualcomm Incorporated Human-body-gesture-based region and volume selection for hmd
US20140232747A1 (en) * 2013-02-15 2014-08-21 Konica Minolta, Inc. Operation display system and operation display method
US20140320389A1 (en) * 2013-04-29 2014-10-30 Michael Scavezze Mixed reality interactions
US20140347390A1 (en) * 2013-05-22 2014-11-27 Adam G. Poulos Body-locked placement of augmented reality objects

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6181343B1 (en) * 1997-12-23 2001-01-30 Philips Electronics North America Corp. System and method for permitting three-dimensional navigation through a virtual reality environment using camera-based gesture inputs
JPH11305907A (ja) * 1998-04-21 1999-11-05 Nippon Telegr & Teleph Corp <Ntt> 仮想現実空間内移動インタフェース装置及び情報生成方法並びに情報生成プログラムを記録した記録媒体
JP2001229394A (ja) * 2000-02-17 2001-08-24 Nippon Telegr & Teleph Corp <Ntt> 仮想空間制御方法、仮想空間制御装置、および仮想空間制御プログラムを記録した記録媒体
JP2001250123A (ja) * 2000-03-06 2001-09-14 Nippon Telegr & Teleph Corp <Ntt> 仮想空間制御方法、仮想空間制御装置、および仮想空間制御プログラムを記録した記録媒体
JP2002157607A (ja) * 2000-11-17 2002-05-31 Canon Inc 画像生成システム、画像生成方法および記憶媒体
US20040095311A1 (en) * 2002-11-19 2004-05-20 Motorola, Inc. Body-centric virtual interactive apparatus and method
US7529690B2 (en) * 2004-05-22 2009-05-05 Altaf Hadi System and method for delivering real time remote buying, selling, meeting, and interacting in a virtual reality environment
JP2006323769A (ja) * 2005-05-20 2006-11-30 Tokai Univ 対面入力装置
KR101060779B1 (ko) * 2006-05-04 2011-08-30 소니 컴퓨터 엔터테인먼트 아메리카 엘엘씨 시각, 음향, 관성, 및 혼합 데이터 중 하나 이상에 근거하여 기어링 효과들을 입력에 적용하기 위한 방법들 및장치들
US8726194B2 (en) * 2007-07-27 2014-05-13 Qualcomm Incorporated Item selection using enhanced control
US8633890B2 (en) * 2010-02-16 2014-01-21 Microsoft Corporation Gesture detection based on joint skipping
US9134534B2 (en) * 2010-02-28 2015-09-15 Microsoft Technology Licensing, Llc See-through near-eye display glasses including a modular image source
US8488246B2 (en) 2010-02-28 2013-07-16 Osterhout Group, Inc. See-through near-eye display glasses including a curved polarizing film in the image source, a partially reflective, partially transmitting optical element and an optically flat film
US9366862B2 (en) * 2010-02-28 2016-06-14 Microsoft Technology Licensing, Llc System and method for delivering content to a group of see-through near eye display eyepieces
CN102906623A (zh) * 2010-02-28 2013-01-30 奥斯特豪特集团有限公司 交互式头戴目镜上的本地广告内容
US20110317871A1 (en) * 2010-06-29 2011-12-29 Microsoft Corporation Skeletal joint recognition and tracking system
US8582867B2 (en) * 2010-09-16 2013-11-12 Primesense Ltd Learning-based pose estimation from depth maps
US8657683B2 (en) * 2011-05-31 2014-02-25 Microsoft Corporation Action selection gesturing
US20120320080A1 (en) * 2011-06-14 2012-12-20 Microsoft Corporation Motion based virtual object navigation
US9002099B2 (en) * 2011-09-11 2015-04-07 Apple Inc. Learning-based estimation of hand and finger pose
US20130137076A1 (en) * 2011-11-30 2013-05-30 Kathryn Stone Perez Head-mounted display based education and instruction
JP5689850B2 (ja) * 2012-05-25 2015-03-25 株式会社ソニー・コンピュータエンタテインメント 映像解析装置、映像解析方法、および注視点表示システム
WO2014033306A1 (en) * 2012-09-03 2014-03-06 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Head mounted system and method to compute and render a stream of digital images using a head mounted system
JP6066676B2 (ja) * 2012-11-06 2017-01-25 株式会社ソニー・インタラクティブエンタテインメント ヘッドマウントディスプレイおよび映像提示システム
US20140282275A1 (en) 2013-03-15 2014-09-18 Qualcomm Incorporated Detection of a zooming gesture
JP2014235634A (ja) * 2013-06-04 2014-12-15 国立大学法人 筑波大学 手指動作検出装置、手指動作検出方法、手指動作検出プログラム、及び仮想物体処理システム
KR101347037B1 (ko) * 2013-07-31 2014-01-03 주식회사 장 자동화 종류가 상이한 식물종자가 부착되는 종자붙임 멀칭재 제조 방법 및 종자붙임 멀칭재
US9285872B1 (en) * 2013-12-12 2016-03-15 Google Inc. Using head gesture and eye position to wake a head mounted device
JP6554631B2 (ja) * 2014-12-18 2019-08-07 フェイスブック・テクノロジーズ・リミテッド・ライアビリティ・カンパニーＦａｃｅｂｏｏｋ Ｔｅｃｈｎｏｌｏｇｉｅｓ， Ｌｌｃ 仮想現実環境においてナビゲートする方法、システム、および装置
US9588593B2 (en) * 2015-06-30 2017-03-07 Ariadne's Thread (Usa), Inc. Virtual reality system with control command gestures

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2006015236A2 (en) * 2004-07-28 2006-02-09 Intelligentek Corporation Audio-visual three-dimensional input/output
WO2013049248A2 (en) * 2011-09-26 2013-04-04 Osterhout Group, Inc. Video display modification based on sensor input for a see-through near-to-eye display
EP2733581A2 (de) * 2012-11-20 2014-05-21 Samsung Electronics Co., Ltd Benutzergesteneingabe in einer tragbaren elektronischen Vorrichtung mit nach außen schauendem Vorrichtungssensor
US20140160001A1 (en) * 2012-12-06 2014-06-12 Peter Tobias Kinnebrew Mixed reality presentation
US20140204002A1 (en) * 2013-01-21 2014-07-24 Rotem Bennet Virtual interaction with image projection
US20140225918A1 (en) * 2013-02-14 2014-08-14 Qualcomm Incorporated Human-body-gesture-based region and volume selection for hmd
US20140232747A1 (en) * 2013-02-15 2014-08-21 Konica Minolta, Inc. Operation display system and operation display method
US20140320389A1 (en) * 2013-04-29 2014-10-30 Michael Scavezze Mixed reality interactions
US20140347390A1 (en) * 2013-05-22 2014-11-27 Adam G. Poulos Body-locked placement of augmented reality objects

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2016100931A1 *

Also Published As

Publication number Publication date
KR20210099163A (ko) 2021-08-11
KR20170081272A (ko) 2017-07-11
CN107209561A (zh) 2017-09-26
WO2016100931A8 (en) 2017-07-13
KR20210097818A (ko) 2021-08-09
US20170169618A1 (en) 2017-06-15
KR20180088754A (ko) 2018-08-06
WO2016100931A1 (en) 2016-06-23
JP6810125B2 (ja) 2021-01-06
JP6554631B2 (ja) 2019-08-07
EP3234741A1 (de) 2017-10-25
US9972136B2 (en) 2018-05-15
KR102284821B1 (ko) 2021-08-03
JP2019083033A (ja) 2019-05-30
JP2018501570A (ja) 2018-01-18
US9659413B2 (en) 2017-05-23
CN113050802A (zh) 2021-06-29
US20160180595A1 (en) 2016-06-23

Similar Documents

Publication Publication Date Title
EP3234741A4 (de) Verfahren, system und vorrichtung zur navigation in einer umgebung der virtuellen realität
IL273415B (en) Methods and systems for creating virtual and augmented reality
EP3234685A4 (de) System, vorrichtung und verfahren zur bereitstellung einer benutzerschnittstelle für eine virtuelle realität
EP3356003A4 (de) Verfahren und system zur interaktion mit einer virtuellen umgebung
EP3329484A4 (de) Systeme und verfahren zur manipulation einer virtuellen umgebung
EP3445463A4 (de) System und vorrichtung für haptik der virtuellen realität
IL250299B (en) A method and system for reconstructing hidden interior parts for a virtual reality environment
EP3318958A4 (de) Vorrichtung für erfahrung in der virtuellen realität
EP3211587A4 (de) Vorrichtung zur virtuellen anprobe und verfahren zur virtuellen anprobe
EP3171602A4 (de) Informationsverarbeitungsvorrichtung, anzeigevorrichtung, informationsverarbeitungsverfahren, programm und informationsverarbeitungssystem
EP3149539A4 (de) Verfahren und systeme zur erzeugung einer anzeige für virtuellen inhalt mit einer vorrichtung für virtuelle oder erweiterte realität
EP3149528A4 (de) Verfahren und system zur erzeugung von fokalebenen in virtueller und erweiterter realität
EP3157242A4 (de) Anzeigesystem, anzeigeverfahren und anzeigevorrichtung
EP3379396A4 (de) Verfahren zum wirken auf virtueller objekte der erweiterten realität
EP3529686A4 (de) Verfahren und vorrichtung zur bereitstellung einer führung in einer virtuellen umgebung
EP3223491A4 (de) Verfahren und vorrichtung zum mapping virtueller datenzentrumsressourcen
EP3351902A4 (de) Navigationssystem, -vorrichtung und -verfahren
EP3142011A4 (de) Anomalienkorrekturverfahren für virtuelle maschinen in einer verteilten umgebung
EP3362878A4 (de) Systeme der virtuellen realität und verfahren für verbesserte klinische ergebnisse
EP3187968A4 (de) Kraftanzeigevorrichtung, kraftanzeigesystem und kraftanzeigeverfahren
EP3226131A4 (de) Skalierungsverfahren und -vorrichtung für virtuelle maschinen (vm)
EP3175381A4 (de) Verfahren und system zur bereitstellung eines perimeters eines virtuellen vermögenswertes
EP3273288A4 (de) Dreidimensionales anzeigeverfahren, dreidimensionale anzeigevorrichtung und anzeigesubstrat
EP2924991B8 (de) System, verfahren und vorrichtung zur anzeige dreidimensionaler bilder
EP3129111A4 (de) Interaktive virtuelle realitätssysteme und verfahren

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20170705

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20180720

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/0481 20130101ALI20180716BHEP

Ipc: G06F 3/01 20060101AFI20180716BHEP

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: FACEBOOK TECHNOLOGIES, LLC

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20200424

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20210912