JP2019506922A5 - - Google Patents

Download PDF

Info

Publication number
JP2019506922A5
JP2019506922A5 JP2018533800A JP2018533800A JP2019506922A5 JP 2019506922 A5 JP2019506922 A5 JP 2019506922A5 JP 2018533800 A JP2018533800 A JP 2018533800A JP 2018533800 A JP2018533800 A JP 2018533800A JP 2019506922 A5 JP2019506922 A5 JP 2019506922A5
Authority
JP
Japan
Prior art keywords
robot
tracking data
head
control unit
hmd
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2018533800A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019506922A (ja
JP6714085B2 (ja
Filing date
Publication date
Application filed filed Critical
Priority claimed from PCT/EP2016/082716 external-priority patent/WO2017114834A1/en
Publication of JP2019506922A publication Critical patent/JP2019506922A/ja
Publication of JP2019506922A5 publication Critical patent/JP2019506922A5/ja
Application granted granted Critical
Publication of JP6714085B2 publication Critical patent/JP6714085B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

JP2018533800A 2015-12-29 2016-12-27 ロボット手術のために仮想現実デバイスを使用するシステム、コントローラ、及び方法 Active JP6714085B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562272512P 2015-12-29 2015-12-29
US62/272,512 2015-12-29
PCT/EP2016/082716 WO2017114834A1 (en) 2015-12-29 2016-12-27 System, controller and method using virtual reality device for robotic surgery

Publications (3)

Publication Number Publication Date
JP2019506922A JP2019506922A (ja) 2019-03-14
JP2019506922A5 true JP2019506922A5 (OSRAM) 2020-02-13
JP6714085B2 JP6714085B2 (ja) 2020-06-24

Family

ID=57714596

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018533800A Active JP6714085B2 (ja) 2015-12-29 2016-12-27 ロボット手術のために仮想現実デバイスを使用するシステム、コントローラ、及び方法

Country Status (5)

Country Link
US (2) US10646289B2 (OSRAM)
EP (1) EP3397185A1 (OSRAM)
JP (1) JP6714085B2 (OSRAM)
CN (1) CN108472095B (OSRAM)
WO (1) WO2017114834A1 (OSRAM)

Families Citing this family (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10179407B2 (en) * 2014-11-16 2019-01-15 Robologics Ltd. Dynamic multi-sensor and multi-robot interface system
EP3349649B1 (en) * 2015-09-18 2022-03-09 Auris Health, Inc. Navigation of tubular networks
WO2017114834A1 (en) * 2015-12-29 2017-07-06 Koninklijke Philips N.V. System, controller and method using virtual reality device for robotic surgery
WO2018078470A1 (en) * 2016-10-25 2018-05-03 Novartis Ag Medical spatial orientation system
JP6850183B2 (ja) * 2017-04-11 2021-03-31 川崎重工業株式会社 ロボットシステム及びその運転方法
CN110494095B (zh) 2017-04-20 2023-03-21 直观外科手术操作公司 用于约束虚拟现实手术系统的系统和方法
US11779192B2 (en) * 2017-05-03 2023-10-10 Covidien Lp Medical image viewer control from surgeon's camera
US10022192B1 (en) 2017-06-23 2018-07-17 Auris Health, Inc. Automatically-initialized robotic systems for navigation of luminal networks
CN107566510B (zh) * 2017-09-20 2020-12-01 歌尔光学科技有限公司 远程医疗诊断服务系统
EP3700457A4 (en) * 2017-10-23 2021-11-17 Intuitive Surgical Operations, Inc. SYSTEMS AND METHODS FOR REPRESENTING EXTENDED REALITY IN A DISPLAY OF A TELEOPERATION SYSTEM
US11925423B2 (en) 2018-01-10 2024-03-12 Covidien Lp Guidance for positioning a patient and surgical robot
US20190254753A1 (en) * 2018-02-19 2019-08-22 Globus Medical, Inc. Augmented reality navigation systems for use with robotic surgical systems and methods of their use
TWI741196B (zh) * 2018-06-26 2021-10-01 華宇藥品股份有限公司 整合擴增實境之手術導航方法及系統
TWI733151B (zh) * 2018-08-01 2021-07-11 鈦隼生物科技股份有限公司 病患位置之術中追蹤方法、系統與可讀取儲存媒體
US11612438B2 (en) 2018-09-05 2023-03-28 Point Robotics Medtech Inc. Navigation system and method for medical operation by a robotic system using a tool
GB2577718B (en) 2018-10-03 2022-08-24 Cmr Surgical Ltd Feature identification
GB2577719B (en) 2018-10-03 2023-04-26 Cmr Surgical Ltd Navigational aid
EP3871143A4 (en) * 2018-10-25 2022-08-31 Beyeonics Surgical Ltd. USER INTERFACE FOR HEAD MOUNTED DISPLAY SYSTEM
DE102018128848A1 (de) * 2018-11-16 2020-05-20 Olympus Winter & Ibe Gmbh Verfahren und Vorrichtung zur Ausführung verschiedener Funktionen im Zusammenhang mit chirurgischen Geräten
CN109410680A (zh) * 2018-11-19 2019-03-01 叶哲伟 一种基于混合现实的虚拟手术训练方法及系统
EP3893797A4 (en) * 2018-12-11 2022-09-07 Project Moray, Inc. HYBRID DIMENSIONAL, AUGMENTED REALITY AND/OR USER INTERFACE REGISTRATION AND SIMULATION SYSTEMS FOR ROBOTIC CATHETER AND OTHER USES
WO2020160129A1 (en) * 2019-01-31 2020-08-06 Intuitive Surgical Operations, Inc. Systems and methods for facilitating insertion of a surgical instrument into a surgical space
KR102297517B1 (ko) * 2019-03-06 2021-09-02 서울대학교 산학협력단 최소 침습 수술을 위한 수술로봇 시스템 및 상기 수술로봇 시스템의 구동방법
CA3152108A1 (en) * 2019-11-05 2021-05-14 Jeffrey BAIL Surgical virtual reality user interface
US11871904B2 (en) * 2019-11-08 2024-01-16 Covidien Ag Steerable endoscope system with augmented view
US12400750B1 (en) 2019-11-15 2025-08-26 Verily Life Sciences Llc Automatic content tagging in videos of minimally invasive surgeries
WO2021126447A1 (en) * 2019-12-19 2021-06-24 Covidien Lp Systems and methods for mitigating collision of a robotic system
CN114760903A (zh) * 2019-12-19 2022-07-15 索尼集团公司 用于在外科手术期间控制图像捕获设备的方法、装置、以及系统
US11864841B2 (en) 2019-12-31 2024-01-09 Carl Zeiss Meditec Ag Method of operating a surgical microscope and surgical microscope
US11409091B2 (en) 2019-12-31 2022-08-09 Carl Zeiss Meditec Ag Method of operating a surgical microscope and surgical microscope
US11607287B2 (en) * 2019-12-31 2023-03-21 Carl Zeiss Meditec Ag Method of operating a surgical microscope and surgical microscope
US11048072B1 (en) * 2019-12-31 2021-06-29 Carl Zeiss Meditec Ag Method of operating a surgical microscope and surgical microscope
IL294566A (en) * 2020-01-06 2022-09-01 Beyeonics Surgical Ltd User interface for controlling a surgical system
US11464581B2 (en) 2020-01-28 2022-10-11 Globus Medical, Inc. Pose measurement chaining for extended reality surgical navigation in visible and near infrared spectrums
GB2593473B (en) * 2020-03-23 2024-09-04 Cmr Surgical Ltd Virtual console for controlling a surgical robot
US11690674B2 (en) * 2020-04-03 2023-07-04 Verb Surgical Inc. Mobile virtual reality system for surgical robotic systems
FR3109237B1 (fr) 2020-04-10 2022-08-05 Virtualisurg Système de connexion d’un dispositif d’entraînement chirurgical à un dispositif virtuel
FR3109078B1 (fr) 2020-04-10 2022-05-06 Virtualisurg Dispositif de simulation chirurgicale
US11607277B2 (en) 2020-04-29 2023-03-21 Globus Medical, Inc. Registration of surgical tool with reference array tracked by cameras of an extended reality headset for assisted navigation during surgery
CN113689949A (zh) * 2020-05-18 2021-11-23 日本电气株式会社 信息处理方法、电子设备和计算机存储介质
WO2021243311A1 (en) * 2020-05-29 2021-12-02 Medtronic, Inc. Extended reality (xr) applications for cardiac arrhythmia procedures
CN112914730B (zh) * 2021-01-19 2022-12-16 上海市第十人民医院 一种基于vr技术的远程介入治疗系统
US12251167B2 (en) * 2021-05-24 2025-03-18 Biosense Webster (Israel) Ltd. Gesture based selection of portion of catheter
JP7701774B2 (ja) * 2021-08-04 2025-07-02 浩太郎 久保 教育ｖｒ用コンテンツ提供プログラム及び医療教育ｖｒ用コンテンツ提供システム
US20230053189A1 (en) * 2021-08-11 2023-02-16 Terumo Cardiovascular Systems Corporation Augmented-reality endoscopic vessel harvesting
CN113766267B (zh) * 2021-09-15 2023-10-24 深圳市道通智能航空技术股份有限公司 基于无人机的多路视频直播方法、系统、设备及存储介质
CN114305695B (zh) * 2021-12-06 2023-12-26 上海微创医疗机器人（集团）股份有限公司 移动指引方法及系统、可读存储介质、及手术机器人系统
CN114972415B (zh) * 2021-12-28 2023-03-28 广东东软学院 机器人视觉跟踪方法、系统、电子设备及介质
US12149624B2 (en) 2022-09-02 2024-11-19 Bank Of America Corporation System and method for pre-authenticating user devices within a metaverse
CN115607294B (zh) * 2022-11-02 2025-09-26 苏州微创畅行机器人有限公司 手术机器人系统和数据处理方法
CN118542635B (zh) * 2024-07-24 2024-10-22 显微智能科技(湖南)有限公司 一种基于眼球运动识别的内窥镜控制系统
CN119257733A (zh) * 2024-09-20 2025-01-07 哈尔滨思哲睿智能医疗设备股份有限公司 一种手术机器人规划导航方法、装置、设备和存储介质

Family Cites Families (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5876325A (en) * 1993-11-02 1999-03-02 Olympus Optical Co., Ltd. Surgical manipulation system
US5641288A (en) * 1996-01-11 1997-06-24 Zaenglein, Jr.; William G. Shooting simulating process and training device using a virtual reality display screen
US6139490A (en) * 1996-02-22 2000-10-31 Precision Optics Corporation Stereoscopic endoscope with virtual reality viewing
US6847336B1 (en) * 1996-10-02 2005-01-25 Jerome H. Lemelson Selectively controllable heads-up display system
US6459926B1 (en) 1998-11-20 2002-10-01 Intuitive Surgical, Inc. Repositioning and reorientation of master/slave relationship in minimally invasive telesurgery
WO2004014244A2 (en) * 2002-08-13 2004-02-19 Microbotics Corporation Microsurgical robot system
EP1782228A1 (en) * 2004-08-03 2007-05-09 Silverbrook Research Pty. Ltd Walk-up printing
WO2008004222A2 (en) * 2006-07-03 2008-01-10 Yissum Research Development Company Of The Hebrew University Of Jerusalem Computer image-aided method and system for guiding instruments through hollow cavities
CN100468295C (zh) * 2007-04-10 2009-03-11 南京航空航天大学 基于人体表面肌电信息的头盔显示器虚拟视觉时延补偿系统及方法
GB0712690D0 (en) * 2007-06-29 2007-08-08 Imp Innovations Ltd Imagee processing
GB2464092A (en) 2008-09-25 2010-04-07 Prosurgics Ltd Surgical mechanism control system
CN102791214B (zh) * 2010-01-08 2016-01-20 皇家飞利浦电子股份有限公司 采用实时速度优化的不经校准的视觉伺服
RU2556593C2 (ru) 2010-01-13 2015-07-10 Конинклейке Филипс Электроникс Н.В. Совмещение и навигация для эндоскопической хирургии на основе интеграции изображений
IT1401669B1 (it) * 2010-04-07 2013-08-02 Sofar Spa Sistema di chirurgia robotizzata con controllo perfezionato.
JP5704833B2 (ja) * 2010-05-10 2015-04-22 オリンパス株式会社 操作入力装置およびマニピュレータシステム
WO2013027202A2 (en) 2011-08-21 2013-02-28 M.S.T. Medical Surgery Technologies Ltd. Device and method for asissting laparoscopic surgery - rule based approach
US20190029765A1 (en) * 2012-06-21 2019-01-31 Globus Medical, Inc. Surgical robotic systems providing transfer of registration and related methods and computer program products
US9058053B2 (en) * 2012-10-26 2015-06-16 The Boeing Company Virtual reality display system
JP2016032485A (ja) * 2012-12-27 2016-03-10 国立大学法人 東京医科歯科大学 内視鏡下手術支援システム及び画像制御方法
KR101811817B1 (ko) * 2013-02-14 2018-01-25 세이코 엡슨 가부시키가이샤 두부 장착형 표시 장치 및 두부 장착형 표시 장치의 제어 방법
KR20140112207A (ko) * 2013-03-13 2014-09-23 삼성전자주식회사 증강현실 영상 표시 시스템 및 이를 포함하는 수술 로봇 시스템
KR20140121581A (ko) 2013-04-08 2014-10-16 삼성전자주식회사 수술 로봇 시스템
US20170115736A1 (en) * 2013-04-10 2017-04-27 Google Inc. Photo-Based Unlock Patterns
US10584940B2 (en) * 2013-05-09 2020-03-10 Shooting Simulator, Llc System and method for marksmanship training
US10274287B2 (en) * 2013-05-09 2019-04-30 Shooting Simulator, Llc System and method for marksmanship training
US9592095B2 (en) * 2013-05-16 2017-03-14 Intuitive Surgical Operations, Inc. Systems and methods for robotic medical system integration with external imaging
RU2642941C2 (ru) * 2013-07-16 2018-01-29 Сейко Эпсон Корпорейшн Устройство обработки информации, способ обработки информации и система обработки информации
JP6252004B2 (ja) * 2013-07-16 2017-12-27 セイコーエプソン株式会社 情報処理装置、情報処理方法、および、情報処理システム
CN104035760A (zh) * 2014-03-04 2014-09-10 苏州天魂网络科技有限公司 跨移动平台实现沉浸式虚拟现实的系统
CN106456148B (zh) * 2014-03-19 2020-06-12 直观外科手术操作公司 使用眼球凝视跟踪的医疗装置、系统和方法
JP2015192697A (ja) * 2014-03-31 2015-11-05 ソニー株式会社 制御装置および制御方法、並びに撮影制御システム
CN106456145B (zh) * 2014-05-05 2020-08-18 维卡瑞斯外科手术股份有限公司 虚拟现实手术装置
CA2957766C (en) * 2014-08-10 2023-10-17 Autonomix Medical, Inc. Ans assessment systems, kits, and methods
US10034508B2 (en) * 2014-08-12 2018-07-31 Microsoft Technology Licensing, Llc Weight-distributing headband for head-worn assembly
WO2016090336A1 (en) * 2014-12-05 2016-06-09 Camplex, Inc. Surgical visualization systems and displays
WO2016092698A1 (ja) * 2014-12-12 2016-06-16 キヤノン株式会社 画像処理装置、画像処理方法およびプログラム
US10154239B2 (en) * 2014-12-30 2018-12-11 Onpoint Medical, Inc. Image-guided surgery with surface reconstruction and augmented reality visualization
US9538962B1 (en) * 2014-12-31 2017-01-10 Verily Life Sciences Llc Heads-up displays for augmented reality network in a medical environment
US10013808B2 (en) * 2015-02-03 2018-07-03 Globus Medical, Inc. Surgeon head-mounted display apparatuses
CN107249497B (zh) * 2015-02-20 2021-03-16 柯惠Lp公司 手术室和手术部位感知
US9703102B2 (en) * 2015-08-28 2017-07-11 Tomy Company Ltd. Information processing device including head mounted display
US10966798B2 (en) * 2015-11-25 2021-04-06 Camplex, Inc. Surgical visualization systems and displays
EP3174267B1 (en) 2015-11-30 2018-11-07 Sap Se Interaction pattern for a mobile telecommunication device
JP6835850B2 (ja) * 2015-12-29 2021-02-24 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 手術ロボットの制御のためのシステム、制御ユニット、及び方法
WO2017114834A1 (en) * 2015-12-29 2017-07-06 Koninklijke Philips N.V. System, controller and method using virtual reality device for robotic surgery
US9861446B2 (en) * 2016-03-12 2018-01-09 Philipp K. Lang Devices and methods for surgery
JP7041068B6 (ja) * 2016-03-17 2022-05-30 コーニンクレッカ フィリップス エヌ ヴェ 剛性近位部及びフレキシブル遠位部を有するハイブリッドロボットを制御するための制御ユニット、システム、及び方法
WO2018005690A1 (en) * 2016-06-28 2018-01-04 Against Gravity Corp. Systems and methods for assisting virtual gestures based on viewing frustum
US10838210B2 (en) * 2016-07-25 2020-11-17 Magic Leap, Inc. Imaging modification, display and visualization using augmented and virtual reality eyewear
US9844321B1 (en) * 2016-08-04 2017-12-19 Novartis Ag Enhanced ophthalmic surgical experience using a virtual reality head-mounted display
US10499997B2 (en) * 2017-01-03 2019-12-10 Mako Surgical Corp. Systems and methods for surgical navigation
EP3529686A4 (en) * 2017-01-13 2019-09-25 Samsung Electronics Co., Ltd. METHOD AND DEVICE FOR PROVIDING A GUIDANCE IN A VIRTUAL ENVIRONMENT
US10416769B2 (en) * 2017-02-14 2019-09-17 Microsoft Technology Licensing, Llc Physical haptic feedback system with spatial warping
KR102550962B1 (ko) * 2017-04-07 2023-07-06 아우리스 헬스, 인코포레이티드 환자 삽입기(Introducer) 정렬
US20180356880A1 (en) * 2017-04-14 2018-12-13 Colopl, Inc. Information processing method and apparatus, and program for executing the information processing method on computer
US10861236B2 (en) * 2017-09-08 2020-12-08 Surgical Theater, Inc. Dual mode augmented reality surgical system and method
WO2019134945A1 (en) * 2018-01-03 2019-07-11 Koninklijke Philips N.V. System and method for detecting abnormal tissue using vascular features
US20190254753A1 (en) * 2018-02-19 2019-08-22 Globus Medical, Inc. Augmented reality navigation systems for use with robotic surgical systems and methods of their use
JP7371026B2 (ja) * 2018-05-31 2023-10-30 オーリス ヘルス インコーポレイテッド 管状網の経路ベースのナビゲーション
JP7271579B2 (ja) * 2018-06-19 2023-05-11 ホウメディカ・オステオニクス・コーポレイション 整形外科手術における複合現実支援を用いた手術支援
CN112804946B (zh) * 2018-08-07 2025-03-25 奥瑞斯健康公司 将基于应变的形状感测与导管控制相结合
CA3121279A1 (en) * 2018-11-30 2020-06-04 Joseph J.K. MA Ocular systems, devices, and methods
JP7138802B2 (ja) * 2019-01-23 2022-09-16 プロプリオ インコーポレイテッド 手術部位のメディエイテッドリアリティビューに対するリアルタイム手術画像への術前スキャン画像のアライメント
CN113473937B (zh) * 2019-02-05 2025-03-11 史密夫和内修有限公司 关节置换手术中的增强现实

Similar Documents

Publication Publication Date Title
JP2019506922A5 (OSRAM)
US11547520B2 (en) Systems, methods, and computer-readable storage media for controlling aspects of a robotic surgical device and viewer adaptive stereoscopic display
US11413099B2 (en) System, controller and method using virtual reality device for robotic surgery
US11977678B2 (en) Robotic system providing user selectable actions associated with gaze tracking
US9767608B2 (en) Augmented reality image display system and surgical robot system comprising the same
CN108778085B (zh) 图像处理设备、内窥镜手术系统以及图像处理方法
US11553974B2 (en) Systems and methods for detection of objects within a field of view of an image capture device
JP2021118883A (ja) 医療用アーム装置、医療用アーム装置の作動方法、及び情報処理装置
CN107249497A (zh) 手术室和手术部位感知
US11094283B2 (en) Head-wearable presentation apparatus, method for operating the same, and medical-optical observation system
EP2862497B1 (en) Manipulator system
JP2016189120A (ja) 情報処理装置、情報処理システム、及び頭部装着ディスプレイ
CN118043005A (zh) 用于控制内部体腔中的手术机器人组件的系统和方法
JP5800609B2 (ja) 医療用マスタスレーブマニピュレータ
KR20110049703A (ko) 수술 로봇 시스템 및 그 복강경 조작 방법
KR101114234B1 (ko) 수술 로봇 시스템 및 그 복강경 조작 방법
KR20150105803A (ko) 자이로 센서를 이용한 3ｄ 내시경 시스템
JP6291355B2 (ja) 電子内視鏡システム及びこれに用いる頭部ジェスチャ検出型遠隔操作装置
JP2025520845A (ja) ガラスまたはヘッドギアを必要とすることなく、外科用ロボットにおける立体視可視化のためのシステムおよび方法