JP2021501939A - オブジェクトの拡張現実ドラッグ及びドロップ - Google Patents

オブジェクトの拡張現実ドラッグ及びドロップ Download PDF

Info

Publication number
JP2021501939A
JP2021501939A JP2020524241A JP2020524241A JP2021501939A JP 2021501939 A JP2021501939 A JP 2021501939A JP 2020524241 A JP2020524241 A JP 2020524241A JP 2020524241 A JP2020524241 A JP 2020524241A JP 2021501939 A JP2021501939 A JP 2021501939A
Authority
JP
Japan
Prior art keywords
drag
drop
physical
augmented reality
virtual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2020524241A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021501939A5 (enExample
Inventor
モリー ララ フレックスマン
モリー ララ フレックスマン
ジャール ジョン ポール ブレイド
ジャール ジョン ポール ブレイド
アトゥル グプタ
アトゥル グプタ
アシシュ パンセ
アシシュ パンセ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2021501939A publication Critical patent/JP2021501939A/ja
Publication of JP2021501939A5 publication Critical patent/JP2021501939A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0486—Drag-and-drop
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
JP2020524241A 2017-11-07 2018-11-06 オブジェクトの拡張現実ドラッグ及びドロップ Pending JP2021501939A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762582484P 2017-11-07 2017-11-07
US62/582,484 2017-11-07
PCT/EP2018/080238 WO2019091943A1 (en) 2017-11-07 2018-11-06 Augmented reality drag and drop of objects

Publications (2)

Publication Number Publication Date
JP2021501939A true JP2021501939A (ja) 2021-01-21
JP2021501939A5 JP2021501939A5 (enExample) 2021-12-16

Family

ID=64184068

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2020524241A Pending JP2021501939A (ja) 2017-11-07 2018-11-06 オブジェクトの拡張現実ドラッグ及びドロップ

Country Status (5)

Country Link
US (1) US20200363924A1 (enExample)
EP (1) EP3707581A1 (enExample)
JP (1) JP2021501939A (enExample)
CN (1) CN111448535A (enExample)
WO (1) WO2019091943A1 (enExample)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3336805A1 (en) * 2016-12-15 2018-06-20 Thomson Licensing Method and device for a placement of a virtual object of an augmented or mixed reality application in a real-world 3d environment
US20200143354A1 (en) * 2018-11-05 2020-05-07 Arknet, Inc. Exploitation of augmented reality and cryptotoken economics in an information-centric network of smartphone users and other imaging cyborgs
US11307647B2 (en) 2019-09-11 2022-04-19 Facebook Technologies, Llc Artificial reality triggered by physical object
US11176755B1 (en) 2020-08-31 2021-11-16 Facebook Technologies, Llc Artificial reality augments and surfaces
US11227445B1 (en) 2020-08-31 2022-01-18 Facebook Technologies, Llc Artificial reality augments and surfaces
US11113893B1 (en) 2020-11-17 2021-09-07 Facebook Technologies, Llc Artificial reality environment with glints displayed by an extra reality device
US11409405B1 (en) 2020-12-22 2022-08-09 Facebook Technologies, Llc Augment orchestration in an artificial reality environment
US11402964B1 (en) * 2021-02-08 2022-08-02 Facebook Technologies, Llc Integrating artificial reality and other computing devices
US11676348B2 (en) 2021-06-02 2023-06-13 Meta Platforms Technologies, Llc Dynamic mixed reality content in virtual reality
US11762952B2 (en) 2021-06-28 2023-09-19 Meta Platforms Technologies, Llc Artificial reality application lifecycle
US11521361B1 (en) 2021-07-01 2022-12-06 Meta Platforms Technologies, Llc Environment model with surfaces and per-surface volumes
US12008717B2 (en) 2021-07-07 2024-06-11 Meta Platforms Technologies, Llc Artificial reality environment control through an artificial reality environment schema
US12056268B2 (en) 2021-08-17 2024-08-06 Meta Platforms Technologies, Llc Platformization of mixed reality objects in virtual reality environments
US11798247B2 (en) 2021-10-27 2023-10-24 Meta Platforms Technologies, Llc Virtual object structures and interrelationships
US11748944B2 (en) 2021-10-27 2023-09-05 Meta Platforms Technologies, Llc Virtual object structures and interrelationships
TW202324172A (zh) 2021-11-10 2023-06-16 美商元平台技術有限公司 自動建立人工實境世界
US12373160B2 (en) * 2021-11-23 2025-07-29 Lenovo (Singapore) Pte. Ltd. Virtual content transfer
US12093447B2 (en) 2022-01-13 2024-09-17 Meta Platforms Technologies, Llc Ephemeral artificial reality experiences
US12067688B2 (en) 2022-02-14 2024-08-20 Meta Platforms Technologies, Llc Coordination of interactions of virtual objects
US20230260239A1 (en) * 2022-02-14 2023-08-17 Meta Platforms, Inc. Turning a Two-Dimensional Image into a Skybox
US12026527B2 (en) 2022-05-10 2024-07-02 Meta Platforms Technologies, Llc World-controlled and application-controlled augments in an artificial-reality environment
US12444152B1 (en) 2022-10-21 2025-10-14 Meta Platforms Technologies, Llc Application multitasking in a three-dimensional environment
US11947862B1 (en) 2022-12-30 2024-04-02 Meta Platforms Technologies, Llc Streaming native application content to artificial reality devices
EP4655664A1 (en) * 2023-01-24 2025-12-03 Snap Inc. Virtual screens using wearable devices

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030020707A1 (en) * 2001-06-27 2003-01-30 Kangas Kari J. User interface
US20140282162A1 (en) * 2013-03-15 2014-09-18 Elwha Llc Cross-reality select, drag, and drop for augmented reality systems
JP2016027468A (ja) * 2014-06-27 2016-02-18 キヤノンマーケティングジャパン株式会社 情報処理装置、情報処理システム、その制御方法及びプログラム

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010110560A2 (ko) * 2009-03-24 2010-09-30 주식회사 래보 증강현실을 이용한 수술 로봇 시스템 및 그 제어 방법
US20130296682A1 (en) * 2012-05-04 2013-11-07 Microsoft Corporation Integrating pre-surgical and surgical images
US20140081659A1 (en) * 2012-09-17 2014-03-20 Depuy Orthopaedics, Inc. Systems and methods for surgical and interventional planning, support, post-operative follow-up, and functional recovery tracking
US20140272863A1 (en) * 2013-03-15 2014-09-18 Peter Kim User Interface For Virtual Reality Surgical Training Simulator
US20150277699A1 (en) * 2013-04-02 2015-10-01 Cherif Atia Algreatly Interaction method for optical head-mounted display
US9696549B2 (en) * 2014-12-22 2017-07-04 International Business Machines Corporation Selectively pairing an application presented in virtual space with a physical display
US10154239B2 (en) * 2014-12-30 2018-12-11 Onpoint Medical, Inc. Image-guided surgery with surface reconstruction and augmented reality visualization
US9685005B2 (en) * 2015-01-02 2017-06-20 Eon Reality, Inc. Virtual lasers for interacting with augmented reality environments
EP3258876B1 (en) * 2015-02-20 2023-10-18 Covidien LP Operating room and surgical site awareness
KR102471977B1 (ko) * 2015-11-06 2022-11-30 삼성전자 주식회사 복수의 전자장치 사이에서 가상 객체를 표시하는 방법 및 이를 지원하는 전자 장치
KR20170089662A (ko) * 2016-01-27 2017-08-04 엘지전자 주식회사 증강현실을 제공하는 웨어러블 디바이스
CN111329552B (zh) * 2016-03-12 2021-06-22 P·K·朗 包括机器人的用于引导骨切除的增强现实可视化
GB2568426B (en) * 2016-08-17 2021-12-15 Synaptive Medical Inc Methods and systems for registration of virtual space with real space in an augmented reality system
WO2018052966A1 (en) * 2016-09-16 2018-03-22 Zimmer, Inc. Augmented reality surgical technique guidance
US20180098813A1 (en) * 2016-10-07 2018-04-12 Simbionix Ltd. Method and system for rendering a medical simulation in an operating room in virtual reality or augmented reality environment
US20190339836A1 (en) * 2016-11-28 2019-11-07 Sony Corporation Information processing apparatus, method, and program
CN108885533B (zh) * 2016-12-21 2021-05-07 杰创科科技有限公司 组合虚拟现实和增强现实
US11270601B2 (en) * 2017-06-29 2022-03-08 Verb Surgical Inc. Virtual reality system for simulating a robotic surgical environment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030020707A1 (en) * 2001-06-27 2003-01-30 Kangas Kari J. User interface
US20140282162A1 (en) * 2013-03-15 2014-09-18 Elwha Llc Cross-reality select, drag, and drop for augmented reality systems
JP2016027468A (ja) * 2014-06-27 2016-02-18 キヤノンマーケティングジャパン株式会社 情報処理装置、情報処理システム、その制御方法及びプログラム

Also Published As

Publication number Publication date
CN111448535A (zh) 2020-07-24
WO2019091943A1 (en) 2019-05-16
US20200363924A1 (en) 2020-11-19
EP3707581A1 (en) 2020-09-16

Similar Documents

Publication Publication Date Title
JP2021501939A (ja) オブジェクトの拡張現実ドラッグ及びドロップ
JP7756079B2 (ja) 外科手術仮想現実ユーザインターフェース
US10592067B2 (en) Distributed interactive medical visualization system with primary/secondary interaction features
Sauer et al. Mixed reality in visceral surgery: development of a suitable workflow and evaluation of intraoperative use-cases
US11069146B2 (en) Augmented reality for collaborative interventions
JP7624975B2 (ja) 仮想マルチユーザコラボレーションにおいて医用画像データを分析するための方法、コンピュータプログラム、ユーザインターフェース、およびシステム
US12277267B2 (en) Two-way communication between head-mounted display and electroanatomic system
CN114173693A (zh) 用于远距监督手术程序的增强现实系统和方法
JP2021512440A (ja) 患者エンゲージメントのシステムおよび方法
JP7613015B2 (ja) コンテキスト及びコンテンツを意識した３Ｄ手ジェスチャ視覚化を伴うＷｅｂベースリモートアシスタンスシステムに関するプログラム
US20250118036A1 (en) Systems and methods for region-based presentation of augmented content
EP3497600B1 (en) Distributed interactive medical visualization system with user interface features
Gallo et al. A user interface for VR-ready 3D medical imaging by off-the-shelf input devices
US20220350401A1 (en) Method and Device for debugging program execution and content playback
Aspin et al. Augmenting the CAVE: An initial study into close focused, inward looking, exploration in IPT systems
Healey et al. Teamwork enables remote surgical control and a new model for a surgical system emerges
JP2009521985A (ja) ３Ｄデータセットのネットワーク（”ＤｅｘｔｒｏＮｅｔ”）上での、協同的でインタラクティブな可視化のためシステムおよび方法
JP2023540127A (ja) 複合現実アプリケーションにおける２ｄ画面インタフェースアプリケーションの制御
Kunii et al. System to check organs, malignant tumors, blood vessel groups, and scalpel paths in DICOM with a 3D stereo immersive sensory HMD
Musthafa et al. Tools and applications for telesurgery in healthcare industry
Sutherland et al. Augmented and Virtual Reality in Medicine
Pucer et al. Augmented Reality in Healthcare
Mukit Intraoperative Virtual Surgical Planning Through Medical Mixed Reality
O'Hara et al. Touchless Interaction in Surgery Touchless interaction with medical images lets surgeons maintain sterility during surgical procedures.
Bucholz et al. An Integrated Surgical Communication Network–SurgON

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211104

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20211104

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20221026

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20221212

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20230308

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20230808