EP3411779A4 - Systems and methods for augmented reality - Google Patents

Systems and methods for augmented reality Download PDF

Info

Publication number
EP3411779A4
EP3411779A4 EP17748352.6A EP17748352A EP3411779A4 EP 3411779 A4 EP3411779 A4 EP 3411779A4 EP 17748352 A EP17748352 A EP 17748352A EP 3411779 A4 EP3411779 A4 EP 3411779A4
Authority
EP
European Patent Office
Prior art keywords
systems
methods
augmented reality
augmented
reality
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP17748352.6A
Other languages
German (de)
French (fr)
Other versions
EP3411779A1 (en
Inventor
Samuel A. MILLER
Michael J. Woods
David C. Lundmark
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magic Leap Inc
Original Assignee
Magic Leap Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/062,104 external-priority patent/US20160259404A1/en
Application filed by Magic Leap Inc filed Critical Magic Leap Inc
Publication of EP3411779A1 publication Critical patent/EP3411779A1/en
Publication of EP3411779A4 publication Critical patent/EP3411779A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/23—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
    • A63F13/235—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console using a wireless connection, e.g. infrared or piconet
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/211—Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25—Output arrangements for video game devices
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35—Details of game servers
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A63F13/525—Changing parameters of virtual cameras
    • A63F13/5255—Changing parameters of virtual cameras according to dedicated instructions from a player, e.g. using a secondary joystick to rotate the camera around a player's character
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Position Input By Displaying (AREA)
EP17748352.6A 2016-02-05 2017-02-06 Systems and methods for augmented reality Withdrawn EP3411779A4 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201662292185P 2016-02-05 2016-02-05
US201662298993P 2016-02-23 2016-02-23
US15/062,104 US20160259404A1 (en) 2015-03-05 2016-03-05 Systems and methods for augmented reality
PCT/US2017/016722 WO2017136833A1 (en) 2016-02-05 2017-02-06 Systems and methods for augmented reality

Publications (2)

Publication Number Publication Date
EP3411779A1 EP3411779A1 (en) 2018-12-12
EP3411779A4 true EP3411779A4 (en) 2019-02-20

Family

ID=59501080

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17748352.6A Withdrawn EP3411779A4 (en) 2016-02-05 2017-02-06 Systems and methods for augmented reality

Country Status (8)

Country Link
EP (1) EP3411779A4 (en)
JP (2) JP2019505926A (en)
KR (1) KR20180110051A (en)
CN (2) CN114995647A (en)
AU (1) AU2017214748B9 (en)
CA (1) CA3011377C (en)
IL (3) IL301449B2 (en)
WO (1) WO2017136833A1 (en)

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10838207B2 (en) 2015-03-05 2020-11-17 Magic Leap, Inc. Systems and methods for augmented reality
AU2016225963B2 (en) 2015-03-05 2021-05-13 Magic Leap, Inc. Systems and methods for augmented reality
US10180734B2 (en) 2015-03-05 2019-01-15 Magic Leap, Inc. Systems and methods for augmented reality
WO2017096396A1 (en) 2015-12-04 2017-06-08 Magic Leap, Inc. Relocalization systems and methods
AU2017305227B2 (en) 2016-08-02 2021-12-16 Magic Leap, Inc. Fixed-distance virtual and augmented reality systems and methods
US10812936B2 (en) 2017-01-23 2020-10-20 Magic Leap, Inc. Localization determination for mixed reality systems
JP7055815B2 (en) 2017-03-17 2022-04-18 マジック リープ， インコーポレイテッド A mixed reality system that involves warping virtual content and how to use it to generate virtual content
US10861237B2 (en) 2017-03-17 2020-12-08 Magic Leap, Inc. Mixed reality system with multi-source virtual content compositing and method of generating virtual content using same
CN117873313A (en) 2017-03-17 2024-04-12 奇跃公司 Mixed reality system with color virtual content distortion and method for generating virtual content using the same
CN107807738B (en) * 2017-12-04 2023-08-15 成都思悟革科技有限公司 Head motion capturing system and method for VR display glasses
US10558260B2 (en) * 2017-12-15 2020-02-11 Microsoft Technology Licensing, Llc Detecting the pose of an out-of-range controller
CN108269310A (en) * 2018-03-20 2018-07-10 公安部上海消防研究所 A kind of interactive exhibition system, method and device
JP7413345B2 (en) 2018-07-23 2024-01-15 マジック リープ， インコーポレイテッド Intra-field subcode timing in field-sequential displays
WO2020023383A1 (en) 2018-07-23 2020-01-30 Magic Leap, Inc. Mixed reality system with virtual content warping and method of generating virtual content using same
US11227435B2 (en) 2018-08-13 2022-01-18 Magic Leap, Inc. Cross reality system
US10957112B2 (en) * 2018-08-13 2021-03-23 Magic Leap, Inc. Cross reality system
EP3846916B1 (en) 2018-09-05 2023-10-25 Magic Leap, Inc. Directed emitter/sensor for electromagnetic tracking in augmented reality systems
US11666203B2 (en) * 2018-10-04 2023-06-06 Biosense Webster (Israel) Ltd. Using a camera with an ENT tool
WO2020072985A1 (en) 2018-10-05 2020-04-09 Magic Leap, Inc. Rendering location specific virtual content in any location
WO2020092297A1 (en) 2018-10-30 2020-05-07 Boston Scientific Scimed, Inc. Devices and methods for treatment of body lumens
US11353588B2 (en) * 2018-11-01 2022-06-07 Waymo Llc Time-of-flight sensor with structured light illuminator
US11347310B2 (en) * 2019-02-21 2022-05-31 Facebook Technologies, Llc Tracking positions of portions of a device based on detection of magnetic fields by magnetic field sensors having predetermined positions
DE102020110212A1 (en) * 2019-04-16 2020-10-22 Ascension Technology Corporation Position and orientation determination with a Helmholtz device
CN110223686A (en) * 2019-05-31 2019-09-10 联想(北京)有限公司 Audio recognition method, speech recognition equipment and electronic equipment
CN114600064A (en) 2019-10-15 2022-06-07 奇跃公司 Cross reality system with location services
CN114616534A (en) 2019-10-15 2022-06-10 奇跃公司 Cross reality system with wireless fingerprint
JP2023504775A (en) 2019-11-12 2023-02-07 マジック リープ， インコーポレイテッド Cross-reality system with localization services and shared location-based content
WO2021118962A1 (en) 2019-12-09 2021-06-17 Magic Leap, Inc. Cross reality system with simplified programming of virtual content
EP4103910A4 (en) 2020-02-13 2024-03-06 Magic Leap, Inc. Cross reality system with accurate shared maps
CN115398484A (en) 2020-02-13 2022-11-25 奇跃公司 Cross reality system with geolocation information priority for location
US11562525B2 (en) 2020-02-13 2023-01-24 Magic Leap, Inc. Cross reality system with map processing using multi-resolution frame descriptors
CN111652261A (en) * 2020-02-26 2020-09-11 南开大学 Multi-modal perception fusion system
CN113539039B (en) * 2021-09-01 2023-01-31 山东柏新医疗制品有限公司 Training device and method for drug application operation of male dilatation catheter
CN114882773A (en) * 2022-05-24 2022-08-09 华北电力大学（保定） Magnetic field learning system based on Augmented Reality
KR20240047186A (en) * 2022-10-04 2024-04-12 삼성전자주식회사 Augmented reality apparatus and operating method thereof

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2358682A1 (en) * 1992-08-14 1994-03-03 British Telecommunications Public Limited Company Position location system
US20100309292A1 (en) * 2007-11-29 2010-12-09 Gwangju Institute Of Science And Technology Method and apparatus for generating multi-viewpoint depth map, method for generating disparity of multi-viewpoint image
US20110238399A1 (en) * 2008-11-19 2011-09-29 Elbit Systems Ltd. System and a method for mapping a magnetic field
EP2887311A1 (en) * 2013-12-20 2015-06-24 Thomson Licensing Method and apparatus for performing depth estimation
US20160026253A1 (en) * 2014-03-11 2016-01-28 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5913820A (en) * 1992-08-14 1999-06-22 British Telecommunications Public Limited Company Position location system
JP2001208529A (en) * 2000-01-26 2001-08-03 Mixed Reality Systems Laboratory Inc Measuring apparatus, control method thereof and memory medium
US20010056574A1 (en) * 2000-06-26 2001-12-27 Richards Angus Duncan VTV system
US20070155589A1 (en) * 2002-12-04 2007-07-05 Philip Feldman Method and Apparatus for Operatively Controlling a Virtual Reality Scenario with an Isometric Exercise System
JP2007134785A (en) * 2005-11-08 2007-05-31 Konica Minolta Photo Imaging Inc Head mounted video display apparatus
US8926511B2 (en) * 2008-02-29 2015-01-06 Biosense Webster, Inc. Location system with virtual touch screen
US8405680B1 (en) * 2010-04-19 2013-03-26 YDreams S.A., A Public Limited Liability Company Various methods and apparatuses for achieving augmented reality
JP6202981B2 (en) * 2013-10-18 2017-09-27 任天堂株式会社 Information processing program, information processing apparatus, information processing system, and information processing method
US20150358539A1 (en) * 2014-06-06 2015-12-10 Jacob Catt Mobile Virtual Reality Camera, Method, And System
CN205007551U (en) * 2015-08-19 2016-02-03 深圳游视虚拟现实技术有限公司 Human -computer interaction system based on virtual reality technology

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2358682A1 (en) * 1992-08-14 1994-03-03 British Telecommunications Public Limited Company Position location system
US20100309292A1 (en) * 2007-11-29 2010-12-09 Gwangju Institute Of Science And Technology Method and apparatus for generating multi-viewpoint depth map, method for generating disparity of multi-viewpoint image
US20110238399A1 (en) * 2008-11-19 2011-09-29 Elbit Systems Ltd. System and a method for mapping a magnetic field
EP2887311A1 (en) * 2013-12-20 2015-06-24 Thomson Licensing Method and apparatus for performing depth estimation
US20160026253A1 (en) * 2014-03-11 2016-01-28 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
NAIR RAHUL ET AL: "A Survey on Time-of-Flight Stereo Fusion", 9 October 2015, MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2015 : 18TH INTERNATIONAL CONFERENCE, MUNICH, GERMANY, OCTOBER 5-9, 2015; PROCEEDINGS; [LECTURE NOTES IN COMPUTER SCIENCE; LECT.NOTES COMPUTER], SPRINGER INTERNATIONAL PUBLISHING, CH, ISBN: 978-3-642-40759-8, ISSN: 0302-9743, XP047148654 *
See also references of WO2017136833A1 *
ZHU J J ET AL: "Joint depth and alpha matte optimization via fusion of stereo and time-of-flight sensor", 2009 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION : CVPR 2009 ; MIAMI [BEACH], FLORIDA, USA, 20 - 25 JUNE 2009, IEEE, PISCATAWAY, NJ, 20 June 2009 (2009-06-20), pages 453 - 460, XP002700137, ISBN: 978-1-4244-3992-8, DOI: 10.1109/CVPRW.2009.5206520 *

Also Published As

Publication number Publication date
CA3011377A1 (en) 2017-08-10
IL301449A (en) 2023-05-01
JP7297028B2 (en) 2023-06-23
IL301449B2 (en) 2024-06-01
AU2017214748B9 (en) 2021-05-27
WO2017136833A1 (en) 2017-08-10
AU2017214748B2 (en) 2021-05-06
IL260614A (en) 2018-08-30
JP2019505926A (en) 2019-02-28
CA3011377C (en) 2024-05-14
CN108700939B (en) 2022-07-05
CN108700939A (en) 2018-10-23
AU2017214748A1 (en) 2018-08-02
CN114995647A (en) 2022-09-02
EP3411779A1 (en) 2018-12-12
IL301449B1 (en) 2024-02-01
KR20180110051A (en) 2018-10-08
IL293782B2 (en) 2023-08-01
IL293782A (en) 2022-08-01
JP2022002144A (en) 2022-01-06
IL293782B1 (en) 2023-04-01

Similar Documents

Publication Publication Date Title
IL293782B1 (en) Systems and methods for augmented reality
EP3440486A4 (en) Systems and methods for augmented reality
IL284939A (en) Systems and methods for augmented reality
EP3857291A4 (en) Systems and methods for augmented reality
EP3433661A4 (en) Virtual and augmented reality systems and methods
EP3405830A4 (en) Augmented reality systems and methods utilizing reflections
EP3423877A4 (en) Virtual and augmented reality systems and methods
EP3338251A4 (en) Virtual and augmented reality systems and methods
EP3308219A4 (en) Virtual and augmented reality systems and methods
EP3500822A4 (en) Systems and methods for augmented stereoscopic display
EP3625774A4 (en) Augmented reality
EP3314564A4 (en) Augmented reality devices, systems and methods for purchasing
EP3625616A4 (en) Systems and methods for mixed reality
EP3513265A4 (en) Systems and methods for near-crash determination
EP3281403A4 (en) Methods and apparatus for augmented reality applications
EP3548456A4 (en) Ethylene-to-liquids systems and methods
EP3155560A4 (en) Methods and systems for creating virtual and augmented reality
EP3494549A4 (en) Fixed-distance virtual and augmented reality systems and methods
EP3417307A4 (en) Systems and methods for augmented reality representations of networks
EP3238181A4 (en) Augmented reality system and method of operation thereof
EP3107484A4 (en) Augmented reality dental design method and system
EP3166079A4 (en) Augmented reality method and system based on wearable device
IL248094A0 (en) Systems and methods for augmented reality
EP3451278A4 (en) Delivery-plan creating system and delivery-plan creating method
EP3612978A4 (en) Systems and methods for encoder-guided adaptive-quality rendering

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180814

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20190117

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/0346 20130101ALI20190111BHEP

Ipc: A63F 13/35 20140101ALI20190111BHEP

Ipc: A63F 13/211 20140101ALI20190111BHEP

Ipc: A63F 13/25 20140101ALI20190111BHEP

Ipc: A63F 13/5255 20140101ALI20190111BHEP

Ipc: G06F 3/00 20060101ALI20190111BHEP

Ipc: G02B 27/00 20060101ALI20190111BHEP

Ipc: A63F 13/213 20140101ALI20190111BHEP

Ipc: A63F 13/235 20140101ALI20190111BHEP

Ipc: G02B 27/01 20060101ALI20190111BHEP

Ipc: G06F 3/01 20060101AFI20190111BHEP

Ipc: G06F 3/03 20060101ALI20190111BHEP

Ipc: A63F 13/52 20140101ALI20190111BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20190817