JP2020520521A - 協働的介入のための拡張現実 - Google Patents

協働的介入のための拡張現実 Download PDF

Info

Publication number
JP2020520521A
JP2020520521A JP2019563618A JP2019563618A JP2020520521A JP 2020520521 A JP2020520521 A JP 2020520521A JP 2019563618 A JP2019563618 A JP 2019563618A JP 2019563618 A JP2019563618 A JP 2019563618A JP 2020520521 A JP2020520521 A JP 2020520521A
Authority
JP
Japan
Prior art keywords
augmented reality
space
shared portion
shared
controller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
JP2019563618A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020520521A5 (https=
Inventor
アシシュ パンセ
アシシュ パンセ
モリー ララ フレックスマン
モリー ララ フレックスマン
アトゥル グプタ
アトゥル グプタ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2020520521A publication Critical patent/JP2020520521A/ja
Publication of JP2020520521A5 publication Critical patent/JP2020520521A5/ja
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H80/00—ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00—Surgical instruments, devices or methods
    • A61B2017/00017—Electrical control of surgical instruments
    • A61B2017/00216—Electrical control of surgical instruments with eye tracking or head position tracking control
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046—Tracking techniques
    • A61B2034/2048—Tracking techniques using an accelerometer or inertia sensor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/371—Surgical systems with images on a monitor during operation with simultaneous use of two cameras
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/372—Details of monitor hardware
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/50—Supports for surgical instruments, e.g. articulated arms
    • A61B2090/502—Headgear, e.g. helmet, spectacles
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Primary Health Care (AREA)
  • Biomedical Technology (AREA)
  • Epidemiology (AREA)
  • General Health & Medical Sciences (AREA)
  • Optics & Photonics (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Business, Economics & Management (AREA)
  • Business, Economics & Management (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Surgery (AREA)
  • Urology & Nephrology (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
JP2019563618A 2017-05-16 2018-05-09 協働的介入のための拡張現実 Ceased JP2020520521A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762506916P 2017-05-16 2017-05-16
US62/506,916 2017-05-16
PCT/EP2018/062013 WO2018210656A1 (en) 2017-05-16 2018-05-09 Augmented reality for collaborative interventions

Publications (2)

Publication Number Publication Date
JP2020520521A true JP2020520521A (ja) 2020-07-09
JP2020520521A5 JP2020520521A5 (https=) 2021-07-26

Family

ID=62244456

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019563618A Ceased JP2020520521A (ja) 2017-05-16 2018-05-09 協働的介入のための拡張現実

Country Status (5)

Country Link
US (1) US11069146B2 (https=)
EP (1) EP3625649A1 (https=)
JP (1) JP2020520521A (https=)
CN (1) CN110914789A (https=)
WO (1) WO2018210656A1 (https=)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022083918A (ja) * 2020-11-25 2022-06-06 ソフトバンク株式会社 眼鏡型デバイス、管理サーバ及びプログラム
JP2023520191A (ja) * 2020-03-23 2023-05-16 シーエムアール サージカル リミテッド 外科手術用ロボットを制御するための仮想コンソール
JP2024507749A (ja) * 2021-02-08 2024-02-21 サイトフル コンピューターズ リミテッド エクステンデッドリアリティにおけるコンテンツ共有
US12474816B2 (en) 2022-09-30 2025-11-18 Sightful Computers Ltd Presenting extended reality content in different physical environments

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200021668A1 (en) * 2018-07-13 2020-01-16 Merge Labs, Inc. Dynamic augmented reality collaboration system using a trackable three-dimensional object
WO2021029180A1 (ja) * 2019-08-15 2021-02-18 富士フイルム株式会社 超音波システムおよび超音波システムの制御方法
EP3926642A1 (en) * 2020-06-17 2021-12-22 Koninklijke Philips N.V. Dynamic positioning for a virtual display
US12118677B2 (en) * 2020-12-22 2024-10-15 Arkh, Inc. Spatially aware environment interaction
JP2022102885A (ja) * 2020-12-25 2022-07-07 富士フイルムビジネスイノベーション株式会社 情報処理装置、情報処理システムおよびプログラム
US20220223270A1 (en) * 2021-01-08 2022-07-14 Expanded Existence, Llc System and method for medical procedure room supply and logistics management
US12324708B2 (en) 2021-02-17 2025-06-10 Derek Duong Augmented reality dental surgery
US12106419B1 (en) 2021-02-18 2024-10-01 Splunk Inc. Live updates in a networked remote collaboration session
US11893675B1 (en) 2021-02-18 2024-02-06 Splunk Inc. Processing updated sensor data for remote collaboration
US12488529B1 (en) 2021-02-18 2025-12-02 Cisco Technology, Inc. Mesh retexturing in an extended reality environment
US12112435B1 (en) * 2021-02-18 2024-10-08 Splunk Inc. Collaboration spaces in extended reality conference sessions
US11915377B1 (en) * 2021-02-18 2024-02-27 Splunk Inc. Collaboration spaces in networked remote collaboration sessions
US12056416B2 (en) * 2021-02-26 2024-08-06 Samsung Electronics Co., Ltd. Augmented reality device and electronic device interacting with augmented reality device
WO2022212144A1 (en) * 2021-03-31 2022-10-06 Snap Inc. User-defined contextual spaces
US12573100B2 (en) 2021-03-31 2026-03-10 Snap Inc. User-defined contextual spaces
CN113706718B (zh) * 2021-07-21 2024-10-29 广州中智达信科技有限公司 一种增强现实的协同方法、系统及应用
CN116392245A (zh) * 2023-04-07 2023-07-07 河北瑞鹤医疗器械有限公司 手术导航系统及手术导航的方法
CN116473674A (zh) * 2023-04-07 2023-07-25 河北瑞鹤医疗器械有限公司 手术导航系统及手术导航的方法

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012168646A (ja) * 2011-02-10 2012-09-06 Sony Corp 情報処理装置、情報共有方法、プログラム及び端末装置
JP2014514652A (ja) * 2011-03-29 2014-06-19 クアルコム，インコーポレイテッド 骨格追跡を使用した物理的表面上への仮想投影上での選択的な手のオクルージョン
JP2015019678A (ja) * 2013-07-16 2015-02-02 セイコーエプソン株式会社 情報処理装置、情報処理方法、および、情報処理システム
JP2015156889A (ja) * 2014-02-21 2015-09-03 ソニー株式会社 表示制御装置、表示装置および表示制御システム
WO2016133644A1 (en) * 2015-02-20 2016-08-25 Covidien Lp Operating room and surgical site awareness
JP2016170641A (ja) * 2015-03-13 2016-09-23 富士フイルム株式会社 仮想オブジェクト表示システムおよびその表示制御方法並びに表示制御プログラム
WO2016158000A1 (ja) * 2015-03-30 2016-10-06 ソニー株式会社 情報処理装置、情報処理方法及び情報処理システム

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070248261A1 (en) * 2005-12-31 2007-10-25 Bracco Imaging, S.P.A. Systems and methods for collaborative interactive visualization of 3D data sets over a network ("DextroNet")
US9122321B2 (en) * 2012-05-04 2015-09-01 Microsoft Technology Licensing, Llc Collaboration environment using see through displays
US20140368537A1 (en) * 2013-06-18 2014-12-18 Tom G. Salter Shared and private holographic objects
CN105117021A (zh) * 2015-09-24 2015-12-02 深圳东方酷音信息技术有限公司 一种虚拟现实内容的生成方法和播放装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012168646A (ja) * 2011-02-10 2012-09-06 Sony Corp 情報処理装置、情報共有方法、プログラム及び端末装置
JP2014514652A (ja) * 2011-03-29 2014-06-19 クアルコム，インコーポレイテッド 骨格追跡を使用した物理的表面上への仮想投影上での選択的な手のオクルージョン
JP2015019678A (ja) * 2013-07-16 2015-02-02 セイコーエプソン株式会社 情報処理装置、情報処理方法、および、情報処理システム
JP2015156889A (ja) * 2014-02-21 2015-09-03 ソニー株式会社 表示制御装置、表示装置および表示制御システム
WO2016133644A1 (en) * 2015-02-20 2016-08-25 Covidien Lp Operating room and surgical site awareness
JP2016170641A (ja) * 2015-03-13 2016-09-23 富士フイルム株式会社 仮想オブジェクト表示システムおよびその表示制御方法並びに表示制御プログラム
WO2016158000A1 (ja) * 2015-03-30 2016-10-06 ソニー株式会社 情報処理装置、情報処理方法及び情報処理システム

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023520191A (ja) * 2020-03-23 2023-05-16 シーエムアール サージカル リミテッド 外科手術用ロボットを制御するための仮想コンソール
JP7445377B2 (ja) 2020-03-23 2024-03-07 シーエムアール サージカル リミテッド 外科手術用ロボットを制御するための仮想コンソール
US12426977B2 (en) 2020-03-23 2025-09-30 Cmr Surgical Limited Virtual console for controlling a surgical robot
JP2022083918A (ja) * 2020-11-25 2022-06-06 ソフトバンク株式会社 眼鏡型デバイス、管理サーバ及びプログラム
JP7187520B2 (ja) 2020-11-25 2022-12-12 ソフトバンク株式会社 眼鏡型デバイス、管理サーバ及びプログラム
JP2024507749A (ja) * 2021-02-08 2024-02-21 サイトフル コンピューターズ リミテッド エクステンデッドリアリティにおけるコンテンツ共有
JP7713189B2 (ja) 2021-02-08 2025-07-25 サイトフル コンピューターズ リミテッド エクステンデッドリアリティにおけるコンテンツ共有
US12474816B2 (en) 2022-09-30 2025-11-18 Sightful Computers Ltd Presenting extended reality content in different physical environments

Also Published As

Publication number Publication date
WO2018210656A1 (en) 2018-11-22
US20200105068A1 (en) 2020-04-02
CN110914789A (zh) 2020-03-24
US11069146B2 (en) 2021-07-20
EP3625649A1 (en) 2020-03-25

Similar Documents

Publication Publication Date Title
JP2020520521A (ja) 協働的介入のための拡張現実
US12506953B2 (en) Device, methods, and graphical user interfaces for capturing and displaying media
US20240087256A1 (en) Methods for depth conflict mitigation in a three-dimensional environment
US11740757B2 (en) Virtual cover for user interaction in augmented reality
CN119440253A (zh) 用于操纵环境中的对象的方法
CN119512362A (zh) 用于显示与媒体内容相关的用户界面元素的方法
CN120266082A (zh) 用于三维环境中的深度冲突减轻的方法
CN120712546A (zh) 用于在三维环境中显示用户界面对象的方法
JP2018505472A (ja) 拡張現実視野オブジェクトフォロワー
CN120447805A (zh) 用于管理三维环境中的内容共享的用户界面
CN119948434A (zh) 包括环境表示的用户界面
KR20250049408A (ko) 3차원 환경들과의 상호작용을 위한 디바이스들, 방법들 및 그래픽 사용자 인터페이스들
CN118435158A (zh) 用于捕获和显示媒体的设备、方法和图形用户界面
CN121889757A (zh) 用于处理到三维环境的输入的设备、方法和图形用户界面
WO2024233224A1 (en) Devices, methods, and graphical user interfaces for providing environment tracking content
EP4689850A1 (en) Devices, methods, and graphical user interfaces for providing environment tracking content
WO2024253842A1 (en) Devices, methods, and graphical user interfaces for real-time communication
EP4720817A1 (en) Devices, methods, and graphical user interfaces for real-time communication
CN121957350A (zh) 用于在三维环境中显示用户界面对象的方法

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210507

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210507

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20220426

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220608

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20220826

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221026

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20230208

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230605

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20230613

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20230707

A045 Written measure of dismissal of application [lapsed due to lack of payment]

Free format text: JAPANESE INTERMEDIATE CODE: A045

Effective date: 20240830