JP2019506922A5 - - Google Patents

Download PDF

Info

Publication number
JP2019506922A5
JP2019506922A5 JP2018533800A JP2018533800A JP2019506922A5 JP 2019506922 A5 JP2019506922 A5 JP 2019506922A5 JP 2018533800 A JP2018533800 A JP 2018533800A JP 2018533800 A JP2018533800 A JP 2018533800A JP 2019506922 A5 JP2019506922 A5 JP 2019506922A5
Authority
JP
Japan
Prior art keywords
robot
tracking data
head
control unit
hmd
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2018533800A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019506922A (ja
JP6714085B2 (ja
Filing date
Publication date
Application filed filed Critical
Priority claimed from PCT/EP2016/082716 external-priority patent/WO2017114834A1/en
Publication of JP2019506922A publication Critical patent/JP2019506922A/ja
Publication of JP2019506922A5 publication Critical patent/JP2019506922A5/ja
Application granted granted Critical
Publication of JP6714085B2 publication Critical patent/JP6714085B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

JP2018533800A 2015-12-29 2016-12-27 ロボット手術のために仮想現実デバイスを使用するシステム、コントローラ、及び方法 Active JP6714085B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562272512P 2015-12-29 2015-12-29
US62/272,512 2015-12-29
PCT/EP2016/082716 WO2017114834A1 (en) 2015-12-29 2016-12-27 System, controller and method using virtual reality device for robotic surgery

Publications (3)

Publication Number Publication Date
JP2019506922A JP2019506922A (ja) 2019-03-14
JP2019506922A5 true JP2019506922A5 (enExample) 2020-02-13
JP6714085B2 JP6714085B2 (ja) 2020-06-24

Family

ID=57714596

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018533800A Active JP6714085B2 (ja) 2015-12-29 2016-12-27 ロボット手術のために仮想現実デバイスを使用するシステム、コントローラ、及び方法

Country Status (5)

Country Link
US (2) US10646289B2 (enExample)
EP (1) EP3397185A1 (enExample)
JP (1) JP6714085B2 (enExample)
CN (1) CN108472095B (enExample)
WO (1) WO2017114834A1 (enExample)

Families Citing this family (55)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10179407B2 (en) * 2014-11-16 2019-01-15 Robologics Ltd. Dynamic multi-sensor and multi-robot interface system
EP4070723B1 (en) * 2015-09-18 2025-08-06 Auris Health, Inc. Navigation of tubular networks
JP6714085B2 (ja) * 2015-12-29 2020-06-24 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． ロボット手術のために仮想現実デバイスを使用するシステム、コントローラ、及び方法
WO2018078470A1 (en) * 2016-10-25 2018-05-03 Novartis Ag Medical spatial orientation system
JP6850183B2 (ja) * 2017-04-11 2021-03-31 川崎重工業株式会社 ロボットシステム及びその運転方法
EP4424267A3 (en) 2017-04-20 2024-10-30 Intuitive Surgical Operations, Inc. Systems and methods for constraining a virtual reality surgical system
US11779192B2 (en) * 2017-05-03 2023-10-10 Covidien Lp Medical image viewer control from surgeon's camera
US10022192B1 (en) 2017-06-23 2018-07-17 Auris Health, Inc. Automatically-initialized robotic systems for navigation of luminal networks
CN107566510B (zh) * 2017-09-20 2020-12-01 歌尔光学科技有限公司 远程医疗诊断服务系统
CN118806424A (zh) 2017-10-23 2024-10-22 直观外科手术操作公司 用于在远程操作系统的显示器中呈现增强现实感的系统和方法
CN111670018B (zh) * 2018-01-10 2024-12-27 柯惠Lp公司 用于定位患者和手术机器人的引导
US20190254753A1 (en) * 2018-02-19 2019-08-22 Globus Medical, Inc. Augmented reality navigation systems for use with robotic surgical systems and methods of their use
TWI741196B (zh) * 2018-06-26 2021-10-01 華宇藥品股份有限公司 整合擴增實境之手術導航方法及系統
JP7457692B2 (ja) * 2018-08-01 2024-03-28 ブレイン ナビ バイオテクノロジー カンパニー リミテッド 手術を実行するためにロボットアームアセンブリの手術経路を更新するためのシステムの作動方法及びそのシステム、並びに記憶媒体
US11612438B2 (en) 2018-09-05 2023-03-28 Point Robotics Medtech Inc. Navigation system and method for medical operation by a robotic system using a tool
GB2577718B (en) 2018-10-03 2022-08-24 Cmr Surgical Ltd Feature identification
GB2577719B (en) 2018-10-03 2023-04-26 Cmr Surgical Ltd Navigational aid
EP3871143A4 (en) 2018-10-25 2022-08-31 Beyeonics Surgical Ltd. USER INTERFACE FOR HEAD MOUNTED DISPLAY SYSTEM
EP4039167A1 (en) 2018-10-26 2022-08-10 Intuitive Surgical Operations, Inc. Mixed reality systems and methods for indicating an extent of a field of view of an imaging device
EP3871193B1 (en) 2018-10-26 2023-12-20 Intuitive Surgical Operations, Inc. Mixed reality systems and methods for indicating an extent of a field of view of an imaging device
DE102018128848A1 (de) * 2018-11-16 2020-05-20 Olympus Winter & Ibe Gmbh Verfahren und Vorrichtung zur Ausführung verschiedener Funktionen im Zusammenhang mit chirurgischen Geräten
CN109410680A (zh) * 2018-11-19 2019-03-01 叶哲伟 一种基于混合现实的虚拟手术训练方法及系统
EP3893797A4 (en) * 2018-12-11 2022-09-07 Project Moray, Inc. HYBRID DIMENSIONAL, AUGMENTED REALITY AND/OR USER INTERFACE REGISTRATION AND SIMULATION SYSTEMS FOR ROBOTIC CATHETER AND OTHER USES
EP3917428A1 (en) * 2019-01-31 2021-12-08 Intuitive Surgical Operations, Inc. Systems and methods for facilitating insertion of a surgical instrument into a surgical space
KR102297517B1 (ko) * 2019-03-06 2021-09-02 서울대학교 산학협력단 최소 침습 수술을 위한 수술로봇 시스템 및 상기 수술로봇 시스템의 구동방법
CN114641251A (zh) * 2019-11-05 2022-06-17 替代外科手术公司 外科手术虚拟现实用户接口
US11871904B2 (en) * 2019-11-08 2024-01-16 Covidien Ag Steerable endoscope system with augmented view
US12400750B1 (en) 2019-11-15 2025-08-26 Verily Life Sciences Llc Automatic content tagging in videos of minimally invasive surgeries
CN114760903A (zh) * 2019-12-19 2022-07-15 索尼集团公司 用于在外科手术期间控制图像捕获设备的方法、装置、以及系统
WO2021126447A1 (en) * 2019-12-19 2021-06-24 Covidien Lp Systems and methods for mitigating collision of a robotic system
US11048072B1 (en) * 2019-12-31 2021-06-29 Carl Zeiss Meditec Ag Method of operating a surgical microscope and surgical microscope
US11864841B2 (en) 2019-12-31 2024-01-09 Carl Zeiss Meditec Ag Method of operating a surgical microscope and surgical microscope
US11409091B2 (en) 2019-12-31 2022-08-09 Carl Zeiss Meditec Ag Method of operating a surgical microscope and surgical microscope
US11607287B2 (en) * 2019-12-31 2023-03-21 Carl Zeiss Meditec Ag Method of operating a surgical microscope and surgical microscope
EP4087514B1 (en) * 2020-01-06 2026-02-25 Beyeonics Surgical Ltd. User interface for controlling a surgical system
US11464581B2 (en) 2020-01-28 2022-10-11 Globus Medical, Inc. Pose measurement chaining for extended reality surgical navigation in visible and near infrared spectrums
GB2593473B (en) * 2020-03-23 2024-09-04 Cmr Surgical Ltd Virtual console for controlling a surgical robot
US11690674B2 (en) * 2020-04-03 2023-07-04 Verb Surgical Inc. Mobile virtual reality system for surgical robotic systems
FR3109078B1 (fr) 2020-04-10 2022-05-06 Virtualisurg Dispositif de simulation chirurgicale
FR3109237B1 (fr) 2020-04-10 2022-08-05 Virtualisurg Système de connexion d’un dispositif d’entraînement chirurgical à un dispositif virtuel
US11607277B2 (en) 2020-04-29 2023-03-21 Globus Medical, Inc. Registration of surgical tool with reference array tracked by cameras of an extended reality headset for assisted navigation during surgery
CN113689949A (zh) * 2020-05-18 2021-11-23 日本电气株式会社 信息处理方法、电子设备和计算机存储介质
WO2021243310A1 (en) * 2020-05-29 2021-12-02 Medtronic, Inc. Intelligent assistance (ia) ecosystem
CN112914730B (zh) * 2021-01-19 2022-12-16 上海市第十人民医院 一种基于vr技术的远程介入治疗系统
US12251167B2 (en) * 2021-05-24 2025-03-18 Biosense Webster (Israel) Ltd. Gesture based selection of portion of catheter
JP7701774B2 (ja) * 2021-08-04 2025-07-02 浩太郎 久保 教育ｖｒ用コンテンツ提供プログラム及び医療教育ｖｒ用コンテンツ提供システム
US12564471B2 (en) * 2021-08-11 2026-03-03 Terumo Cardiovascular Systems Corporation Augmented-reality endoscopic vessel harvesting
CN113766267B (zh) * 2021-09-15 2023-10-24 深圳市道通智能航空技术股份有限公司 基于无人机的多路视频直播方法、系统、设备及存储介质
CN114305695B (zh) * 2021-12-06 2023-12-26 上海微创医疗机器人（集团）股份有限公司 移动指引方法及系统、可读存储介质、及手术机器人系统
CN114972415B (zh) * 2021-12-28 2023-03-28 广东东软学院 机器人视觉跟踪方法、系统、电子设备及介质
US12149624B2 (en) 2022-09-02 2024-11-19 Bank Of America Corporation System and method for pre-authenticating user devices within a metaverse
CN115607294B (zh) * 2022-11-02 2025-09-26 苏州微创畅行机器人有限公司 手术机器人系统和数据处理方法
CN116152331A (zh) * 2023-02-08 2023-05-23 上海微创医疗机器人（集团）股份有限公司 图像获取组件的调节方法、装置及操作系统
CN118542635B (zh) * 2024-07-24 2024-10-22 显微智能科技(湖南)有限公司 一种基于眼球运动识别的内窥镜控制系统
CN119257733A (zh) * 2024-09-20 2025-01-07 哈尔滨思哲睿智能医疗设备股份有限公司 一种手术机器人规划导航方法、装置、设备和存储介质

Family Cites Families (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5876325A (en) * 1993-11-02 1999-03-02 Olympus Optical Co., Ltd. Surgical manipulation system
US5641288A (en) * 1996-01-11 1997-06-24 Zaenglein, Jr.; William G. Shooting simulating process and training device using a virtual reality display screen
US6139490A (en) * 1996-02-22 2000-10-31 Precision Optics Corporation Stereoscopic endoscope with virtual reality viewing
US6847336B1 (en) * 1996-10-02 2005-01-25 Jerome H. Lemelson Selectively controllable heads-up display system
US6459926B1 (en) 1998-11-20 2002-10-01 Intuitive Surgical, Inc. Repositioning and reorientation of master/slave relationship in minimally invasive telesurgery
EP1531749A2 (en) * 2002-08-13 2005-05-25 Microbotics Corporation Microsurgical robot system
AU2005269254B2 (en) * 2004-08-03 2009-06-18 Silverbrook Research Pty Ltd Electronic stylus
WO2008004222A2 (en) * 2006-07-03 2008-01-10 Yissum Research Development Company Of The Hebrew University Of Jerusalem Computer image-aided method and system for guiding instruments through hollow cavities
CN100468295C (zh) * 2007-04-10 2009-03-11 南京航空航天大学 基于人体表面肌电信息的头盔显示器虚拟视觉时延补偿系统及方法
GB0712690D0 (en) * 2007-06-29 2007-08-08 Imp Innovations Ltd Imagee processing
GB2464092A (en) 2008-09-25 2010-04-07 Prosurgics Ltd Surgical mechanism control system
US8934003B2 (en) * 2010-01-08 2015-01-13 Koninklijkle Philips N.V. Uncalibrated visual servoing using real-time velocity optimization
EP2523621B1 (en) 2010-01-13 2016-09-28 Koninklijke Philips N.V. Image integration based registration and navigation for endoscopic surgery
IT1401669B1 (it) * 2010-04-07 2013-08-02 Sofar Spa Sistema di chirurgia robotizzata con controllo perfezionato.
JP5704833B2 (ja) * 2010-05-10 2015-04-22 オリンパス株式会社 操作入力装置およびマニピュレータシステム
WO2013027202A2 (en) 2011-08-21 2013-02-28 M.S.T. Medical Surgery Technologies Ltd. Device and method for asissting laparoscopic surgery - rule based approach
US20190029765A1 (en) * 2012-06-21 2019-01-31 Globus Medical, Inc. Surgical robotic systems providing transfer of registration and related methods and computer program products
US9058053B2 (en) * 2012-10-26 2015-06-16 The Boeing Company Virtual reality display system
JP2016032485A (ja) * 2012-12-27 2016-03-10 国立大学法人 東京医科歯科大学 内視鏡下手術支援システム及び画像制御方法
EP2956814A1 (en) * 2013-02-14 2015-12-23 Seiko Epson Corporation Head mounted display and control method for head mounted display
KR20140112207A (ko) * 2013-03-13 2014-09-23 삼성전자주식회사 증강현실 영상 표시 시스템 및 이를 포함하는 수술 로봇 시스템
KR20140121581A (ko) 2013-04-08 2014-10-16 삼성전자주식회사 수술 로봇 시스템
US20170115736A1 (en) * 2013-04-10 2017-04-27 Google Inc. Photo-Based Unlock Patterns
US10584940B2 (en) * 2013-05-09 2020-03-10 Shooting Simulator, Llc System and method for marksmanship training
US10274287B2 (en) * 2013-05-09 2019-04-30 Shooting Simulator, Llc System and method for marksmanship training
US9592095B2 (en) * 2013-05-16 2017-03-14 Intuitive Surgical Operations, Inc. Systems and methods for robotic medical system integration with external imaging
US10042598B2 (en) * 2013-07-16 2018-08-07 Seiko Epson Corporation Information processing apparatus, information processing method, and information processing system
JP6252004B2 (ja) * 2013-07-16 2017-12-27 セイコーエプソン株式会社 情報処理装置、情報処理方法、および、情報処理システム
CN104035760A (zh) * 2014-03-04 2014-09-10 苏州天魂网络科技有限公司 跨移动平台实现沉浸式虚拟现实的系统
WO2015143067A1 (en) * 2014-03-19 2015-09-24 Intuitive Surgical Operations, Inc. Medical devices, systems, and methods using eye gaze tracking
JP2015192697A (ja) * 2014-03-31 2015-11-05 ソニー株式会社 制御装置および制御方法、並びに撮影制御システム
CA2946595A1 (en) * 2014-05-05 2015-11-12 Vicarious Surgical Inc. Virtual reality surgical device
US10791924B2 (en) * 2014-08-10 2020-10-06 Autonomix Medical, Inc. ANS assessment systems, kits, and methods
US10034508B2 (en) * 2014-08-12 2018-07-31 Microsoft Technology Licensing, Llc Weight-distributing headband for head-worn assembly
EP3226799A4 (en) * 2014-12-05 2018-07-25 Camplex, Inc. Surgical visualization systems and displays
JP6526051B2 (ja) * 2014-12-12 2019-06-05 キヤノン株式会社 画像処理装置、画像処理方法およびプログラム
US10154239B2 (en) * 2014-12-30 2018-12-11 Onpoint Medical, Inc. Image-guided surgery with surface reconstruction and augmented reality visualization
US9538962B1 (en) * 2014-12-31 2017-01-10 Verily Life Sciences Llc Heads-up displays for augmented reality network in a medical environment
US10013808B2 (en) * 2015-02-03 2018-07-03 Globus Medical, Inc. Surgeon head-mounted display apparatuses
WO2016133644A1 (en) * 2015-02-20 2016-08-25 Covidien Lp Operating room and surgical site awareness
JP5944600B1 (ja) * 2015-08-28 2016-07-05 株式会社タカラトミー 頭部装着型ディスプレイを備えた情報処理装置
US10966798B2 (en) * 2015-11-25 2021-04-06 Camplex, Inc. Surgical visualization systems and displays
EP3174267B1 (en) 2015-11-30 2018-11-07 Sap Se Interaction pattern for a mobile telecommunication device
JP6714085B2 (ja) * 2015-12-29 2020-06-24 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． ロボット手術のために仮想現実デバイスを使用するシステム、コントローラ、及び方法
JP6835850B2 (ja) * 2015-12-29 2021-02-24 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 手術ロボットの制御のためのシステム、制御ユニット、及び方法
CA3016604A1 (en) * 2016-03-12 2017-09-21 Philipp K. Lang Devices and methods for surgery
EP3429496B1 (en) * 2016-03-17 2025-07-09 Koninklijke Philips N.V. Control unit, system and method for controlling hybrid robot having rigid proximal portion and flexible distal portion
US10990169B2 (en) * 2016-06-28 2021-04-27 Rec Room Inc. Systems and methods for assisting virtual gestures based on viewing frustum
CN119644594A (zh) * 2016-07-25 2025-03-18 奇跃公司 使用增强和虚拟现实眼镜的成像修改、显示和可视化
US9844321B1 (en) * 2016-08-04 2017-12-19 Novartis Ag Enhanced ophthalmic surgical experience using a virtual reality head-mounted display
US10499997B2 (en) * 2017-01-03 2019-12-10 Mako Surgical Corp. Systems and methods for surgical navigation
US10984595B2 (en) * 2017-01-13 2021-04-20 Samsung Electronics Co. Ltd Method and apparatus for providing guidance in a virtual environment
US10416769B2 (en) * 2017-02-14 2019-09-17 Microsoft Technology Licensing, Llc Physical haptic feedback system with spatial warping
US10987174B2 (en) * 2017-04-07 2021-04-27 Auris Health, Inc. Patient introducer alignment
US20180356880A1 (en) * 2017-04-14 2018-12-13 Colopl, Inc. Information processing method and apparatus, and program for executing the information processing method on computer
US10861236B2 (en) * 2017-09-08 2020-12-08 Surgical Theater, Inc. Dual mode augmented reality surgical system and method
JP7181298B2 (ja) * 2018-01-03 2022-11-30 コーニンクレッカ フィリップス エヌ ヴェ 血管特徴を使用して異常な組織を検出するためのシステム及び方法
US20190254753A1 (en) * 2018-02-19 2019-08-22 Globus Medical, Inc. Augmented reality navigation systems for use with robotic surgical systems and methods of their use
EP4454591A3 (en) * 2018-05-31 2025-01-15 Auris Health, Inc. Path-based navigation of tubular networks
EP4464271A3 (en) * 2018-06-19 2025-01-22 Howmedica Osteonics Corp. Visualization of intraoperatively modified surgical plans
EP3820373A4 (en) * 2018-08-07 2022-04-27 Auris Health, Inc. COMBINATION OF STRAIN-BASED FORM MEASUREMENT WITH CATHETER CONTROL
WO2020107127A1 (en) * 2018-11-30 2020-06-04 Ma Joseph J K Ocular systems, devices, and methods
JP7138802B2 (ja) * 2019-01-23 2022-09-16 プロプリオ インコーポレイテッド 手術部位のメディエイテッドリアリティビューに対するリアルタイム手術画像への術前スキャン画像のアライメント
WO2020163358A1 (en) * 2019-02-05 2020-08-13 Smith & Nephew, Inc. Computer-assisted arthroplasty system to improve patellar performance

Similar Documents

Publication Publication Date Title
JP2019506922A5 (enExample)
US11547520B2 (en) Systems, methods, and computer-readable storage media for controlling aspects of a robotic surgical device and viewer adaptive stereoscopic display
US11413099B2 (en) System, controller and method using virtual reality device for robotic surgery
US11977678B2 (en) Robotic system providing user selectable actions associated with gaze tracking
US9767608B2 (en) Augmented reality image display system and surgical robot system comprising the same
CN108778085B (zh) 图像处理设备、内窥镜手术系统以及图像处理方法
US11094283B2 (en) Head-wearable presentation apparatus, method for operating the same, and medical-optical observation system
US11553974B2 (en) Systems and methods for detection of objects within a field of view of an image capture device
JP2021118883A (ja) 医療用アーム装置、医療用アーム装置の作動方法、及び情報処理装置
CN107249497A (zh) 手术室和手术部位感知
CN102958464A (zh) 具有改进的控制器的自动化外科手术系统
EP2862497B1 (en) Manipulator system
CN118043005A (zh) 用于控制内部体腔中的手术机器人组件的系统和方法
JP2013017513A (ja) 医療用マスタスレーブマニピュレータ
JP5800609B2 (ja) 医療用マスタスレーブマニピュレータ
KR101114234B1 (ko) 수술 로봇 시스템 및 그 복강경 조작 방법
JP2025520845A (ja) ガラスまたはヘッドギアを必要とすることなく、外科用ロボットにおける立体視可視化のためのシステムおよび方法
JP6291355B2 (ja) 電子内視鏡システム及びこれに用いる頭部ジェスチャ検出型遠隔操作装置
JP2024097269A5 (enExample)