CN110914789A - 用于协同介入的增强现实 - Google Patents

用于协同介入的增强现实 Download PDF

Info

Publication number
CN110914789A
CN110914789A CN201880047279.5A CN201880047279A CN110914789A CN 110914789 A CN110914789 A CN 110914789A CN 201880047279 A CN201880047279 A CN 201880047279A CN 110914789 A CN110914789 A CN 110914789A
Authority
CN
China
Prior art keywords
augmented reality
controller
space
shared portion
shared
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201880047279.5A
Other languages
English (en)
Chinese (zh)
Inventor
A·潘斯
M·L·弗莱克斯曼
A·古普塔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of CN110914789A publication Critical patent/CN110914789A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H80/00—ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods
    • A61B2017/00017—Electrical control of surgical instruments
    • A61B2017/00216—Electrical control of surgical instruments with eye tracking or head position tracking control
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2048—Tracking techniques using an accelerometer or inertia sensor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/371—Surgical systems with images on a monitor during operation with simultaneous use of two cameras
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/372—Details of monitor hardware
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/50—Supports for surgical instruments, e.g. articulated arms
    • A61B2090/502—Headgear, e.g. helmet, spectacles
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Primary Health Care (AREA)
  • Biomedical Technology (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Optics & Photonics (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Business, Economics & Management (AREA)
  • Business, Economics & Management (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Surgery (AREA)
  • Urology & Nephrology (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
CN201880047279.5A 2017-05-16 2018-05-09 用于协同介入的增强现实 Pending CN110914789A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762506916P 2017-05-16 2017-05-16
US62/506,916 2017-05-16
PCT/EP2018/062013 WO2018210656A1 (en) 2017-05-16 2018-05-09 Augmented reality for collaborative interventions

Publications (1)

Publication Number Publication Date
CN110914789A true CN110914789A (zh) 2020-03-24

Family

ID=62244456

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880047279.5A Pending CN110914789A (zh) 2017-05-16 2018-05-09 用于协同介入的增强现实

Country Status (5)

Country Link
US (1) US11069146B2 (https=)
EP (1) EP3625649A1 (https=)
JP (1) JP2020520521A (https=)
CN (1) CN110914789A (https=)
WO (1) WO2018210656A1 (https=)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113706718A (zh) * 2021-07-21 2021-11-26 广州中智达信科技有限公司 一种增强现实的协同方法、系统及应用
CN116392245A (zh) * 2023-04-07 2023-07-07 河北瑞鹤医疗器械有限公司 手术导航系统及手术导航的方法
CN116473674A (zh) * 2023-04-07 2023-07-25 河北瑞鹤医疗器械有限公司 手术导航系统及手术导航的方法

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200021668A1 (en) * 2018-07-13 2020-01-16 Merge Labs, Inc. Dynamic augmented reality collaboration system using a trackable three-dimensional object
WO2021029180A1 (ja) * 2019-08-15 2021-02-18 富士フイルム株式会社 超音波システムおよび超音波システムの制御方法
GB2593473B (en) 2020-03-23 2024-09-04 Cmr Surgical Ltd Virtual console for controlling a surgical robot
EP3926642A1 (en) * 2020-06-17 2021-12-22 Koninklijke Philips N.V. Dynamic positioning for a virtual display
JP7187520B2 (ja) * 2020-11-25 2022-12-12 ソフトバンク株式会社 眼鏡型デバイス、管理サーバ及びプログラム
US12118677B2 (en) * 2020-12-22 2024-10-15 Arkh, Inc. Spatially aware environment interaction
JP2022102885A (ja) * 2020-12-25 2022-07-07 富士フイルムビジネスイノベーション株式会社 情報処理装置、情報処理システムおよびプログラム
US20220223270A1 (en) * 2021-01-08 2022-07-14 Expanded Existence, Llc System and method for medical procedure room supply and logistics management
EP4295314A4 (en) * 2021-02-08 2025-04-16 Sightful Computers Ltd EXTENDED REALITY CONTENT SHARING
US12324708B2 (en) 2021-02-17 2025-06-10 Derek Duong Augmented reality dental surgery
US12106419B1 (en) 2021-02-18 2024-10-01 Splunk Inc. Live updates in a networked remote collaboration session
US11893675B1 (en) 2021-02-18 2024-02-06 Splunk Inc. Processing updated sensor data for remote collaboration
US12488529B1 (en) 2021-02-18 2025-12-02 Cisco Technology, Inc. Mesh retexturing in an extended reality environment
US12112435B1 (en) * 2021-02-18 2024-10-08 Splunk Inc. Collaboration spaces in extended reality conference sessions
US11915377B1 (en) * 2021-02-18 2024-02-27 Splunk Inc. Collaboration spaces in networked remote collaboration sessions
US12056416B2 (en) * 2021-02-26 2024-08-06 Samsung Electronics Co., Ltd. Augmented reality device and electronic device interacting with augmented reality device
WO2022212144A1 (en) * 2021-03-31 2022-10-06 Snap Inc. User-defined contextual spaces
US12573100B2 (en) 2021-03-31 2026-03-10 Snap Inc. User-defined contextual spaces
EP4595015A1 (en) 2022-09-30 2025-08-06 Sightful Computers Ltd Adaptive extended reality content presentation in multiple physical environments

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070248261A1 (en) * 2005-12-31 2007-10-25 Bracco Imaging, S.P.A. Systems and methods for collaborative interactive visualization of 3D data sets over a network ("DextroNet")
US20130293468A1 (en) * 2012-05-04 2013-11-07 Kathryn Stone Perez Collaboration environment using see through displays
US20140368537A1 (en) * 2013-06-18 2014-12-18 Tom G. Salter Shared and private holographic objects
CN104298499A (zh) * 2013-07-16 2015-01-21 精工爱普生株式会社 信息处理装置、信息处理方法、以及信息处理系统
CN105117021A (zh) * 2015-09-24 2015-12-02 深圳东方酷音信息技术有限公司 一种虚拟现实内容的生成方法和播放装置
WO2016133644A1 (en) * 2015-02-20 2016-08-25 Covidien Lp Operating room and surgical site awareness
JP2016170641A (ja) * 2015-03-13 2016-09-23 富士フイルム株式会社 仮想オブジェクト表示システムおよびその表示制御方法並びに表示制御プログラム

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5776201B2 (ja) * 2011-02-10 2015-09-09 ソニー株式会社 情報処理装置、情報共有方法、プログラム及び端末装置
JP5784818B2 (ja) * 2011-03-29 2015-09-24 クアルコム，インコーポレイテッド 拡張現実システムにおける実世界表面への仮想画像のアンカリング
JP6264087B2 (ja) * 2014-02-21 2018-01-24 ソニー株式会社 表示制御装置、表示装置および表示制御システム
JP6693507B2 (ja) * 2015-03-30 2020-05-13 ソニー株式会社 情報処理装置、情報処理方法及び情報処理システム

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070248261A1 (en) * 2005-12-31 2007-10-25 Bracco Imaging, S.P.A. Systems and methods for collaborative interactive visualization of 3D data sets over a network ("DextroNet")
US20130293468A1 (en) * 2012-05-04 2013-11-07 Kathryn Stone Perez Collaboration environment using see through displays
US20140368537A1 (en) * 2013-06-18 2014-12-18 Tom G. Salter Shared and private holographic objects
CN104298499A (zh) * 2013-07-16 2015-01-21 精工爱普生株式会社 信息处理装置、信息处理方法、以及信息处理系统
WO2016133644A1 (en) * 2015-02-20 2016-08-25 Covidien Lp Operating room and surgical site awareness
JP2016170641A (ja) * 2015-03-13 2016-09-23 富士フイルム株式会社 仮想オブジェクト表示システムおよびその表示制御方法並びに表示制御プログラム
CN105117021A (zh) * 2015-09-24 2015-12-02 深圳东方酷音信息技术有限公司 一种虚拟现实内容的生成方法和播放装置

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113706718A (zh) * 2021-07-21 2021-11-26 广州中智达信科技有限公司 一种增强现实的协同方法、系统及应用
CN113706718B (zh) * 2021-07-21 2024-10-29 广州中智达信科技有限公司 一种增强现实的协同方法、系统及应用
CN116392245A (zh) * 2023-04-07 2023-07-07 河北瑞鹤医疗器械有限公司 手术导航系统及手术导航的方法
CN116473674A (zh) * 2023-04-07 2023-07-25 河北瑞鹤医疗器械有限公司 手术导航系统及手术导航的方法

Also Published As

Publication number Publication date
WO2018210656A1 (en) 2018-11-22
US20200105068A1 (en) 2020-04-02
JP2020520521A (ja) 2020-07-09
US11069146B2 (en) 2021-07-20
EP3625649A1 (en) 2020-03-25

Similar Documents

Publication Publication Date Title
CN110914789A (zh) 用于协同介入的增强现实
US11740757B2 (en) Virtual cover for user interaction in augmented reality
KR20250065914A (ko) 3차원 환경에서 깊이 충돌 완화를 위한 방법들
JP6364022B2 (ja) 多重現実環境における役割切り替えのためのシステムおよび方法
Hua et al. SCAPE: supporting stereoscopic collaboration in augmented and projective environments
CN119473001A (zh) 用于显示和重新定位环境中的对象的方法
CN119923616A (zh) 用于操纵虚拟对象的方法
CN119948437A (zh) 用于改善用户环境感知的方法
CN120045066A (zh) 用于三维环境的相对操纵的方法
CN119440253A (zh) 用于操纵环境中的对象的方法
CN121569266A (zh) 用于在通信会话中共享内容的设备、方法和图形用户界面
CN120653120A (zh) 用于三维环境中的深度冲突减轻的方法
CN120201069A (zh) 多用户通信会话中的混合空间组内的交互
CN107209565A (zh) 固定大小的增强现实对象
CN116648683A (zh) 用于选择对象的方法和系统
CN120447805A (zh) 用于管理三维环境中的内容共享的用户界面
US20210081051A1 (en) Methods, apparatus, systems, computer programs for enabling mediated reality
EP3825816A1 (en) Rendering a virtual object on a virtual user interface
Kunii et al. System to check organs, malignant tumors, blood vessel groups, and scalpel paths in DICOM with a 3D stereo immersive sensory HMD
JP2026005805A (ja) インターフェースシステム
Spindler et al. Towards spatially aware tangible displays for the masses
CN121263772A (zh) 用于管理音频源的设备、方法和图形用户界面
CN121957350A (zh) 用于在三维环境中显示用户界面对象的方法
CN121889757A (zh) 用于处理到三维环境的输入的设备、方法和图形用户界面
CN120876596A (zh) 多用户通信会话中的参与者的骨架数据跟踪

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination