JP7353982B2 - 拡張現実におけるユーザインタラクションのための仮想カバー - Google Patents

拡張現実におけるユーザインタラクションのための仮想カバー Download PDF

Info

Publication number
JP7353982B2
JP7353982B2 JP2019563626A JP2019563626A JP7353982B2 JP 7353982 B2 JP7353982 B2 JP 7353982B2 JP 2019563626 A JP2019563626 A JP 2019563626A JP 2019563626 A JP2019563626 A JP 2019563626A JP 7353982 B2 JP7353982 B2 JP 7353982B2
Authority
JP
Japan
Prior art keywords
virtual
space
user
augmented reality
control device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019563626A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020520522A5 (enExample
JP2020520522A (ja
Inventor
アシシュ パンセ
モリー ララ フレックスマン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2020520522A publication Critical patent/JP2020520522A/ja
Publication of JP2020520522A5 publication Critical patent/JP2020520522A5/ja
Application granted granted Critical
Publication of JP7353982B2 publication Critical patent/JP7353982B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Epidemiology (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Primary Health Care (AREA)
  • Medical Informatics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computer Hardware Design (AREA)
  • Surgery (AREA)
  • Urology & Nephrology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
JP2019563626A 2017-05-16 2018-05-09 拡張現実におけるユーザインタラクションのための仮想カバー Active JP7353982B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762506895P 2017-05-16 2017-05-16
US62/506,895 2017-05-16
PCT/EP2018/061947 WO2018210645A1 (en) 2017-05-16 2018-05-09 Virtual cover for user interaction in augmented reality

Publications (3)

Publication Number Publication Date
JP2020520522A JP2020520522A (ja) 2020-07-09
JP2020520522A5 JP2020520522A5 (enExample) 2021-07-26
JP7353982B2 true JP7353982B2 (ja) 2023-10-02

Family

ID=62244455

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019563626A Active JP7353982B2 (ja) 2017-05-16 2018-05-09 拡張現実におけるユーザインタラクションのための仮想カバー

Country Status (5)

Country Link
US (2) US11334213B2 (enExample)
EP (1) EP3635512B1 (enExample)
JP (1) JP7353982B2 (enExample)
CN (1) CN110914788A (enExample)
WO (1) WO2018210645A1 (enExample)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11571107B2 (en) * 2019-03-25 2023-02-07 Karl Storz Imaging, Inc. Automated endoscopic device control systems
US11612316B2 (en) * 2019-06-20 2023-03-28 Awss Zidan Medical system and method operable to control sensor-based wearable devices for examining eyes
JP2021114116A (ja) * 2020-01-17 2021-08-05 パナソニックＩｐマネジメント株式会社 設備制御システム、制御方法、及びプログラム
EP4030219B1 (en) * 2021-01-13 2025-07-30 BHS Technologies GmbH Medical imaging system and method of controlling such imaging system
US11334215B1 (en) 2021-04-09 2022-05-17 Htc Corporation Method of generating user-interactive object, multimedia system, and non-transitory computer-readable medium
TWI837468B (zh) * 2021-04-09 2024-04-01 宏達國際電子股份有限公司 使用者可互動物件生成方法、多媒體系統與非暫態電腦可讀取媒體
CN113343303A (zh) * 2021-06-29 2021-09-03 视伴科技(北京)有限公司 一种遮蔽目标房间的方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013232062A (ja) 2012-04-27 2013-11-14 Mitsubishi Electric Corp タッチパネル誤操作防止入出力装置
WO2014045683A1 (ja) 2012-09-21 2014-03-27 ソニー株式会社 制御装置および記憶媒体
US20160054791A1 (en) 2014-08-25 2016-02-25 Daqri, Llc Navigating augmented reality content with a watch
US20160191887A1 (en) 2014-12-30 2016-06-30 Carlos Quiles Casas Image-guided surgery with surface reconstruction and augmented reality visualization

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9152309B1 (en) * 2008-03-28 2015-10-06 Google Inc. Touch screen locking and unlocking
CA2727474A1 (en) * 2010-07-16 2012-01-16 Exopc Method for controlling interactions of a user with a given zone of a touch screen panel
US20120249416A1 (en) * 2011-03-29 2012-10-04 Giuliano Maciocci Modular mobile connected pico projectors for a local multi-user collaboration
US20130050069A1 (en) * 2011-08-23 2013-02-28 Sony Corporation, A Japanese Corporation Method and system for use in providing three dimensional user interface
US9791921B2 (en) * 2013-02-19 2017-10-17 Microsoft Technology Licensing, Llc Context-aware augmented reality object commands
US10288881B2 (en) * 2013-03-14 2019-05-14 Fresenius Medical Care Holdings, Inc. Wearable interface for remote monitoring and control of a medical device
US10416760B2 (en) * 2014-07-25 2019-09-17 Microsoft Technology Licensing, Llc Gaze-based object placement within a virtual reality environment
US9852546B2 (en) * 2015-01-28 2017-12-26 CCP hf. Method and system for receiving gesture input via virtual control objects
US10007413B2 (en) * 2015-04-27 2018-06-26 Microsoft Technology Licensing, Llc Mixed environment display of attached control elements
JP6684559B2 (ja) * 2015-09-16 2020-04-22 株式会社バンダイナムコエンターテインメント プログラムおよび画像生成装置
US10546109B2 (en) * 2017-02-14 2020-01-28 Qualcomm Incorporated Smart touchscreen display

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013232062A (ja) 2012-04-27 2013-11-14 Mitsubishi Electric Corp タッチパネル誤操作防止入出力装置
WO2014045683A1 (ja) 2012-09-21 2014-03-27 ソニー株式会社 制御装置および記憶媒体
US20160054791A1 (en) 2014-08-25 2016-02-25 Daqri, Llc Navigating augmented reality content with a watch
US20160191887A1 (en) 2014-12-30 2016-06-30 Carlos Quiles Casas Image-guided surgery with surface reconstruction and augmented reality visualization

Also Published As

Publication number Publication date
WO2018210645A1 (en) 2018-11-22
US20220276764A1 (en) 2022-09-01
US20210165556A1 (en) 2021-06-03
CN110914788A (zh) 2020-03-24
JP2020520522A (ja) 2020-07-09
EP3635512A1 (en) 2020-04-15
US11740757B2 (en) 2023-08-29
US11334213B2 (en) 2022-05-17
EP3635512B1 (en) 2025-10-08

Similar Documents

Publication Publication Date Title
JP7353982B2 (ja) 拡張現実におけるユーザインタラクションのための仮想カバー
US11069146B2 (en) Augmented reality for collaborative interventions
JP7549173B2 (ja) 医療アシスタント
CN120723067A (zh) 用于三维环境中的深度冲突缓解的方法
CN106102633B (zh) 用于远程操作医疗系统的结构调整系统和方法
JP7756079B2 (ja) 外科手術仮想現実ユーザインターフェース
CN110099649B (zh) 具有用于工具致动的虚拟控制面板的机器人外科系统
JP7448551B2 (ja) コンピュータ支援手術システムのためのカメラ制御システム及び方法
CN109890311A (zh) 在计算机辅助远程操作外科手术中的可重新配置的显示器
KR20170084186A (ko) 사용자 인터페이스와 마스터 제어기 사이의 상호작용
US20240104860A1 (en) Devices, Methods, and Graphical User Interfaces for Interacting with Three-Dimensional Environments
US20230186574A1 (en) Systems and methods for region-based presentation of augmented content
CN120712546A (zh) 用于在三维环境中显示用户界面对象的方法
CN120266082A (zh) 用于三维环境中的深度冲突减轻的方法
US20210286701A1 (en) View-Based Breakpoints For A Display System
WO2023014732A1 (en) Techniques for adjusting a field of view of an imaging device based on head motion of an operator
CN119895356A (zh) 用于管理三维环境中的内容共享的用户界面
CN119948451A (zh) 用于与三维环境进行交互的设备、方法和图形用户界面
EP3825816A1 (en) Rendering a virtual object on a virtual user interface
de Boer The effects of situated visualized telepresence on task performance in gesture-based teleoperation
EP4345838A1 (en) Visualizing an indication of a location in a medical facility
WO2024253842A1 (en) Devices, methods, and graphical user interfaces for real-time communication
WO2024233224A1 (en) Devices, methods, and graphical user interfaces for providing environment tracking content
Elle et al. Head tracking of a surgical robotic scopeholder-a user involvement test of the system
JP2017012690A (ja) 対象者誘導装置、対象者誘導システム、対象者誘導方法及びプログラム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210507

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210507

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220427

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20220428

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20220720

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221020

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20230201

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230525

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20230602

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20230822

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20230920

R150 Certificate of patent or registration of utility model

Ref document number: 7353982

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150