CN111448535A - 对象的增强现实拖放 - Google Patents

对象的增强现实拖放 Download PDF

Info

Publication number
CN111448535A
CN111448535A CN201880078799.2A CN201880078799A CN111448535A CN 111448535 A CN111448535 A CN 111448535A CN 201880078799 A CN201880078799 A CN 201880078799A CN 111448535 A CN111448535 A CN 111448535A
Authority
CN
China
Prior art keywords
drag
physical
augmented reality
drop
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201880078799.2A
Other languages
English (en)
Chinese (zh)
Inventor
M·L·弗莱克斯曼
J·J·P·布里吉
A·古普塔
A·潘斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of CN111448535A publication Critical patent/CN111448535A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486—Drag-and-drop
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
CN201880078799.2A 2017-11-07 2018-11-06 对象的增强现实拖放 Pending CN111448535A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762582484P 2017-11-07 2017-11-07
US62/582,484 2017-11-07
PCT/EP2018/080238 WO2019091943A1 (en) 2017-11-07 2018-11-06 Augmented reality drag and drop of objects

Publications (1)

Publication Number Publication Date
CN111448535A true CN111448535A (zh) 2020-07-24

Family

ID=64184068

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880078799.2A Pending CN111448535A (zh) 2017-11-07 2018-11-06 对象的增强现实拖放

Country Status (5)

Country Link
US (1) US20200363924A1 (enExample)
EP (1) EP3707581A1 (enExample)
JP (1) JP2021501939A (enExample)
CN (1) CN111448535A (enExample)
WO (1) WO2019091943A1 (enExample)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3336805A1 (en) * 2016-12-15 2018-06-20 Thomson Licensing Method and device for a placement of a virtual object of an augmented or mixed reality application in a real-world 3d environment
US20200143354A1 (en) * 2018-11-05 2020-05-07 Arknet, Inc. Exploitation of augmented reality and cryptotoken economics in an information-centric network of smartphone users and other imaging cyborgs
US11307647B2 (en) 2019-09-11 2022-04-19 Facebook Technologies, Llc Artificial reality triggered by physical object
US11176755B1 (en) 2020-08-31 2021-11-16 Facebook Technologies, Llc Artificial reality augments and surfaces
US11227445B1 (en) 2020-08-31 2022-01-18 Facebook Technologies, Llc Artificial reality augments and surfaces
US11113893B1 (en) 2020-11-17 2021-09-07 Facebook Technologies, Llc Artificial reality environment with glints displayed by an extra reality device
US11409405B1 (en) 2020-12-22 2022-08-09 Facebook Technologies, Llc Augment orchestration in an artificial reality environment
US11402964B1 (en) * 2021-02-08 2022-08-02 Facebook Technologies, Llc Integrating artificial reality and other computing devices
US11676348B2 (en) 2021-06-02 2023-06-13 Meta Platforms Technologies, Llc Dynamic mixed reality content in virtual reality
US11762952B2 (en) 2021-06-28 2023-09-19 Meta Platforms Technologies, Llc Artificial reality application lifecycle
US11521361B1 (en) 2021-07-01 2022-12-06 Meta Platforms Technologies, Llc Environment model with surfaces and per-surface volumes
US12008717B2 (en) 2021-07-07 2024-06-11 Meta Platforms Technologies, Llc Artificial reality environment control through an artificial reality environment schema
US12056268B2 (en) 2021-08-17 2024-08-06 Meta Platforms Technologies, Llc Platformization of mixed reality objects in virtual reality environments
US11798247B2 (en) 2021-10-27 2023-10-24 Meta Platforms Technologies, Llc Virtual object structures and interrelationships
US11748944B2 (en) 2021-10-27 2023-09-05 Meta Platforms Technologies, Llc Virtual object structures and interrelationships
TW202324172A (zh) 2021-11-10 2023-06-16 美商元平台技術有限公司 自動建立人工實境世界
US12373160B2 (en) * 2021-11-23 2025-07-29 Lenovo (Singapore) Pte. Ltd. Virtual content transfer
US12093447B2 (en) 2022-01-13 2024-09-17 Meta Platforms Technologies, Llc Ephemeral artificial reality experiences
US12067688B2 (en) 2022-02-14 2024-08-20 Meta Platforms Technologies, Llc Coordination of interactions of virtual objects
US20230260239A1 (en) * 2022-02-14 2023-08-17 Meta Platforms, Inc. Turning a Two-Dimensional Image into a Skybox
US12026527B2 (en) 2022-05-10 2024-07-02 Meta Platforms Technologies, Llc World-controlled and application-controlled augments in an artificial-reality environment
US12444152B1 (en) 2022-10-21 2025-10-14 Meta Platforms Technologies, Llc Application multitasking in a three-dimensional environment
US11947862B1 (en) 2022-12-30 2024-04-02 Meta Platforms Technologies, Llc Streaming native application content to artificial reality devices
EP4655664A1 (en) * 2023-01-24 2025-12-03 Snap Inc. Virtual screens using wearable devices

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140282162A1 (en) * 2013-03-15 2014-09-18 Elwha Llc Cross-reality select, drag, and drop for augmented reality systems
US20160196692A1 (en) * 2015-01-02 2016-07-07 Eon Reality, Inc. Virtual lasers for interacting with augmented reality environments
US20170131964A1 (en) * 2015-11-06 2017-05-11 Samsung Electronics Co., Ltd. Method for displaying virtual object in plural electronic devices and electronic device supporting the method
CN107111365A (zh) * 2014-12-22 2017-08-29 国际商业机器公司 将虚拟空间中呈现的应用与物理显示器进行选择性配对

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2377147A (en) * 2001-06-27 2002-12-31 Nokia Corp A virtual reality user interface
WO2010110560A2 (ko) * 2009-03-24 2010-09-30 주식회사 래보 증강현실을 이용한 수술 로봇 시스템 및 그 제어 방법
US20130296682A1 (en) * 2012-05-04 2013-11-07 Microsoft Corporation Integrating pre-surgical and surgical images
US20140081659A1 (en) * 2012-09-17 2014-03-20 Depuy Orthopaedics, Inc. Systems and methods for surgical and interventional planning, support, post-operative follow-up, and functional recovery tracking
US20140272863A1 (en) * 2013-03-15 2014-09-18 Peter Kim User Interface For Virtual Reality Surgical Training Simulator
US20150277699A1 (en) * 2013-04-02 2015-10-01 Cherif Atia Algreatly Interaction method for optical head-mounted display
JP6292181B2 (ja) * 2014-06-27 2018-03-14 キヤノンマーケティングジャパン株式会社 情報処理装置、情報処理システム、その制御方法及びプログラム
US10154239B2 (en) * 2014-12-30 2018-12-11 Onpoint Medical, Inc. Image-guided surgery with surface reconstruction and augmented reality visualization
EP3258876B1 (en) * 2015-02-20 2023-10-18 Covidien LP Operating room and surgical site awareness
KR20170089662A (ko) * 2016-01-27 2017-08-04 엘지전자 주식회사 증강현실을 제공하는 웨어러블 디바이스
CN111329552B (zh) * 2016-03-12 2021-06-22 P·K·朗 包括机器人的用于引导骨切除的增强现实可视化
GB2568426B (en) * 2016-08-17 2021-12-15 Synaptive Medical Inc Methods and systems for registration of virtual space with real space in an augmented reality system
WO2018052966A1 (en) * 2016-09-16 2018-03-22 Zimmer, Inc. Augmented reality surgical technique guidance
US20180098813A1 (en) * 2016-10-07 2018-04-12 Simbionix Ltd. Method and system for rendering a medical simulation in an operating room in virtual reality or augmented reality environment
US20190339836A1 (en) * 2016-11-28 2019-11-07 Sony Corporation Information processing apparatus, method, and program
CN108885533B (zh) * 2016-12-21 2021-05-07 杰创科科技有限公司 组合虚拟现实和增强现实
US11270601B2 (en) * 2017-06-29 2022-03-08 Verb Surgical Inc. Virtual reality system for simulating a robotic surgical environment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140282162A1 (en) * 2013-03-15 2014-09-18 Elwha Llc Cross-reality select, drag, and drop for augmented reality systems
CN105229588A (zh) * 2013-03-15 2016-01-06 埃尔瓦有限公司 用于增强现实系统中的交叉现实选择、拖拽和放置
CN107111365A (zh) * 2014-12-22 2017-08-29 国际商业机器公司 将虚拟空间中呈现的应用与物理显示器进行选择性配对
US20160196692A1 (en) * 2015-01-02 2016-07-07 Eon Reality, Inc. Virtual lasers for interacting with augmented reality environments
US20170131964A1 (en) * 2015-11-06 2017-05-11 Samsung Electronics Co., Ltd. Method for displaying virtual object in plural electronic devices and electronic device supporting the method

Also Published As

Publication number Publication date
WO2019091943A1 (en) 2019-05-16
JP2021501939A (ja) 2021-01-21
US20200363924A1 (en) 2020-11-19
EP3707581A1 (en) 2020-09-16

Similar Documents

Publication Publication Date Title
CN111448535A (zh) 对象的增强现实拖放
US20250239374A1 (en) Graphical user interfaces including touchpad driving interfaces for telemedicine devices
US11069146B2 (en) Augmented reality for collaborative interventions
Sauer et al. Mixed reality in visceral surgery: development of a suitable workflow and evaluation of intraoperative use-cases
JP7756079B2 (ja) 外科手術仮想現実ユーザインターフェース
US12277267B2 (en) Two-way communication between head-mounted display and electroanatomic system
CN114173693A (zh) 用于远距监督手术程序的增强现实系统和方法
JP2021512440A (ja) 患者エンゲージメントのシステムおよび方法
US20210275264A1 (en) Graphical User Guidance for a Robotic Surgical System
US20070248261A1 (en) Systems and methods for collaborative interactive visualization of 3D data sets over a network ("DextroNet")
US20120278759A1 (en) Integration system for medical instruments with remote control
US20150091778A1 (en) Medical image display system and method
US20120256950A1 (en) Medical support apparatus, medical support method, and medical support system
EP3790023A1 (en) Method for analyzing medical image data in a virtual multi-user collaboration, a computer program, a user interface and a system
JP2022513013A (ja) 複合現実のための仮想オブジェクトの体系的配置
JP7613015B2 (ja) コンテキスト及びコンテンツを意識した３Ｄ手ジェスチャ視覚化を伴うＷｅｂベースリモートアシスタンスシステムに関するプログラム
WO2013176760A1 (en) Graphical user interfaces including touchpad driving interfaces for telemedicine devices
CN108292194A (zh) 用于显示数据的装置
Karim et al. Telepointer technology in telemedicine: a review
WO2021231293A1 (en) Systems and methods for region-based presentation of augmented content
JP2006142022A (ja) 利用者によりマッピングされた関心領域を用いた画像の同期方法及び装置
CN110164531A (zh) 用于显示三维医学影像信息的方法
Healey et al. Teamwork enables remote surgical control and a new model for a surgical system emerges
JP2009521985A (ja) ３Ｄデータセットのネットワーク（”ＤｅｘｔｒｏＮｅｔ”）上での、協同的でインタラクティブな可視化のためシステムおよび方法
JP2023540127A (ja) 複合現実アプリケーションにおける２ｄ画面インタフェースアプリケーションの制御

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20200724

WD01 Invention patent application deemed withdrawn after publication