CN110914788A - 用于增强现实中的用户交互的虚拟覆盖物 - Google Patents

用于增强现实中的用户交互的虚拟覆盖物 Download PDF

Info

Publication number
CN110914788A
CN110914788A CN201880047219.3A CN201880047219A CN110914788A CN 110914788 A CN110914788 A CN 110914788A CN 201880047219 A CN201880047219 A CN 201880047219A CN 110914788 A CN110914788 A CN 110914788A
Authority
CN
China
Prior art keywords
virtual
space
operating member
controller
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201880047219.3A
Other languages
English (en)
Chinese (zh)
Inventor
A·潘斯
M·L·弗莱克斯曼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of CN110914788A publication Critical patent/CN110914788A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Epidemiology (AREA)
  • Medical Informatics (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Biomedical Technology (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Multimedia (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Optics & Photonics (AREA)
  • General Business, Economics & Management (AREA)
  • Business, Economics & Management (AREA)
  • Urology & Nephrology (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • User Interface Of Digital Computer (AREA)
CN201880047219.3A 2017-05-16 2018-05-09 用于增强现实中的用户交互的虚拟覆盖物 Pending CN110914788A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762506895P 2017-05-16 2017-05-16
US62/506,895 2017-05-16
PCT/EP2018/061947 WO2018210645A1 (en) 2017-05-16 2018-05-09 Virtual cover for user interaction in augmented reality

Publications (1)

Publication Number Publication Date
CN110914788A true CN110914788A (zh) 2020-03-24

Family

ID=62244455

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880047219.3A Pending CN110914788A (zh) 2017-05-16 2018-05-09 用于增强现实中的用户交互的虚拟覆盖物

Country Status (5)

Country Link
US (2) US11334213B2 (enExample)
EP (1) EP3635512B1 (enExample)
JP (1) JP7353982B2 (enExample)
CN (1) CN110914788A (enExample)
WO (1) WO2018210645A1 (enExample)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113343303A (zh) * 2021-06-29 2021-09-03 视伴科技(北京)有限公司 一种遮蔽目标房间的方法及装置
US11334215B1 (en) 2021-04-09 2022-05-17 Htc Corporation Method of generating user-interactive object, multimedia system, and non-transitory computer-readable medium
TWI837468B (zh) * 2021-04-09 2024-04-01 宏達國際電子股份有限公司 使用者可互動物件生成方法、多媒體系統與非暫態電腦可讀取媒體

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11571107B2 (en) * 2019-03-25 2023-02-07 Karl Storz Imaging, Inc. Automated endoscopic device control systems
US11612316B2 (en) * 2019-06-20 2023-03-28 Awss Zidan Medical system and method operable to control sensor-based wearable devices for examining eyes
JP2021114116A (ja) * 2020-01-17 2021-08-05 パナソニックＩｐマネジメント株式会社 設備制御システム、制御方法、及びプログラム
EP4030219B1 (en) * 2021-01-13 2025-07-30 BHS Technologies GmbH Medical imaging system and method of controlling such imaging system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120249416A1 (en) * 2011-03-29 2012-10-04 Giuliano Maciocci Modular mobile connected pico projectors for a local multi-user collaboration
CN105009031A (zh) * 2013-02-19 2015-10-28 微软公司 上下文知晓增强现实对象命令
US20160217614A1 (en) * 2015-01-28 2016-07-28 CCP hf. Method and System for Receiving Gesture Input Via Virtual Control Objects
CN106575153A (zh) * 2014-07-25 2017-04-19 微软技术许可有限责任公司 虚拟现实环境内基于注视的对象放置

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9152309B1 (en) * 2008-03-28 2015-10-06 Google Inc. Touch screen locking and unlocking
CA2727474A1 (en) * 2010-07-16 2012-01-16 Exopc Method for controlling interactions of a user with a given zone of a touch screen panel
US20130050069A1 (en) * 2011-08-23 2013-02-28 Sony Corporation, A Japanese Corporation Method and system for use in providing three dimensional user interface
JP5875456B2 (ja) 2012-04-27 2016-03-02 三菱電機株式会社 タッチパネル誤操作防止入出力装置
RU2015108948A (ru) 2012-09-21 2016-10-10 Сони Корпорейшн Устройство управления и носитель информации
US10288881B2 (en) * 2013-03-14 2019-05-14 Fresenius Medical Care Holdings, Inc. Wearable interface for remote monitoring and control of a medical device
US20160054791A1 (en) 2014-08-25 2016-02-25 Daqri, Llc Navigating augmented reality content with a watch
US10154239B2 (en) 2014-12-30 2018-12-11 Onpoint Medical, Inc. Image-guided surgery with surface reconstruction and augmented reality visualization
US10007413B2 (en) * 2015-04-27 2018-06-26 Microsoft Technology Licensing, Llc Mixed environment display of attached control elements
JP6684559B2 (ja) * 2015-09-16 2020-04-22 株式会社バンダイナムコエンターテインメント プログラムおよび画像生成装置
US10546109B2 (en) * 2017-02-14 2020-01-28 Qualcomm Incorporated Smart touchscreen display

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120249416A1 (en) * 2011-03-29 2012-10-04 Giuliano Maciocci Modular mobile connected pico projectors for a local multi-user collaboration
CN105009031A (zh) * 2013-02-19 2015-10-28 微软公司 上下文知晓增强现实对象命令
CN106575153A (zh) * 2014-07-25 2017-04-19 微软技术许可有限责任公司 虚拟现实环境内基于注视的对象放置
US20160217614A1 (en) * 2015-01-28 2016-07-28 CCP hf. Method and System for Receiving Gesture Input Via Virtual Control Objects

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11334215B1 (en) 2021-04-09 2022-05-17 Htc Corporation Method of generating user-interactive object, multimedia system, and non-transitory computer-readable medium
TWI837468B (zh) * 2021-04-09 2024-04-01 宏達國際電子股份有限公司 使用者可互動物件生成方法、多媒體系統與非暫態電腦可讀取媒體
CN113343303A (zh) * 2021-06-29 2021-09-03 视伴科技(北京)有限公司 一种遮蔽目标房间的方法及装置

Also Published As

Publication number Publication date
US11740757B2 (en) 2023-08-29
WO2018210645A1 (en) 2018-11-22
JP2020520522A (ja) 2020-07-09
EP3635512A1 (en) 2020-04-15
EP3635512B1 (en) 2025-10-08
JP7353982B2 (ja) 2023-10-02
US11334213B2 (en) 2022-05-17
US20220276764A1 (en) 2022-09-01
US20210165556A1 (en) 2021-06-03

Similar Documents

Publication Publication Date Title
US11740757B2 (en) Virtual cover for user interaction in augmented reality
US11069146B2 (en) Augmented reality for collaborative interventions
US11340756B2 (en) Devices, methods, and graphical user interfaces for interacting with three-dimensional environments
KR20250065914A (ko) 3차원 환경에서 깊이 충돌 완화를 위한 방법들
CN103180893B (zh) 用于提供三维用户界面的方法和系统
CN119365840A (zh) 用于三维环境的相对操纵的方法
CN119923616A (zh) 用于操纵虚拟对象的方法
CN110476142A (zh) 虚拟对象用户界面显示
AU2022221706B2 (en) User interfaces and device settings based on user identification
CN116648683A (zh) 用于选择对象的方法和系统
CN120712546A (zh) 用于在三维环境中显示用户界面对象的方法
CN120266082A (zh) 用于三维环境中的深度冲突减轻的方法
CN119885141A (zh) 用于用户认证和设备管理的设备、方法和图形用户界面
US20240362312A1 (en) Electronic Device System With Ring Devices
US20210081051A1 (en) Methods, apparatus, systems, computer programs for enabling mediated reality
CN119895356A (zh) 用于管理三维环境中的内容共享的用户界面
CN120723115A (zh) 用于与三维环境进行交互的设备、方法和图形用户界面
EP3825816A1 (en) Rendering a virtual object on a virtual user interface
CN121219693A (zh) 用于在多种操作模式之间转变的设备、方法和图形用户界面

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination