JP7146772B2 - コンテクストオーバレイを提供する拡張現実インターベンションシステム - Google Patents

コンテクストオーバレイを提供する拡張現実インターベンションシステム Download PDF

Info

Publication number
JP7146772B2
JP7146772B2 JP2019537767A JP2019537767A JP7146772B2 JP 7146772 B2 JP7146772 B2 JP 7146772B2 JP 2019537767 A JP2019537767 A JP 2019537767A JP 2019537767 A JP2019537767 A JP 2019537767A JP 7146772 B2 JP7146772 B2 JP 7146772B2
Authority
JP
Japan
Prior art keywords
user
graphics processing
processing module
context overlay
overlay
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019537767A
Other languages
English (en)
Japanese (ja)
Other versions
JP2020510461A (ja
JP2020510461A5 (enExample
Inventor
モリー ララ フレクスマン
アレクサンドラ ポポヴィク
アシシュ パンセ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2020510461A publication Critical patent/JP2020510461A/ja
Publication of JP2020510461A5 publication Critical patent/JP2020510461A5/ja
Application granted granted Critical
Publication of JP7146772B2 publication Critical patent/JP7146772B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/25—User interfaces for surgical systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/003—Repetitive work cycles; Sequence of movements
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/25—User interfaces for surgical systems
    • A61B2034/252—User interfaces for surgical systems indicating steps of a surgical procedure
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
    • A61B2090/3762—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy using computed tomography systems [CT]
    • A61B2090/3764—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy using computed tomography systems [CT] with a rotating C-arm having a cone beam emitting source
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/41—Medical

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Business, Economics & Management (AREA)
  • Public Health (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Educational Administration (AREA)
  • Radiology & Medical Imaging (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Veterinary Medicine (AREA)
  • Educational Technology (AREA)
  • General Business, Economics & Management (AREA)
  • Pathology (AREA)
  • Robotics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Gynecology & Obstetrics (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • User Interface Of Digital Computer (AREA)
JP2019537767A 2017-01-17 2018-01-15 コンテクストオーバレイを提供する拡張現実インターベンションシステム Active JP7146772B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762447069P 2017-01-17 2017-01-17
US62/447,069 2017-01-17
PCT/EP2018/050806 WO2018134140A1 (en) 2017-01-17 2018-01-15 Augmented reality interventional system providing contextual overlays

Publications (3)

Publication Number Publication Date
JP2020510461A JP2020510461A (ja) 2020-04-09
JP2020510461A5 JP2020510461A5 (enExample) 2021-02-04
JP7146772B2 true JP7146772B2 (ja) 2022-10-04

Family

ID=61163661

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019537767A Active JP7146772B2 (ja) 2017-01-17 2018-01-15 コンテクストオーバレイを提供する拡張現実インターベンションシステム

Country Status (5)

Country Link
US (3) US11551380B2 (enExample)
EP (1) EP3571698A1 (enExample)
JP (1) JP7146772B2 (enExample)
CN (1) CN110199357B (enExample)
WO (1) WO2018134140A1 (enExample)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9566414B2 (en) 2013-03-13 2017-02-14 Hansen Medical, Inc. Integrated catheter and guide wire controller
US10849702B2 (en) 2013-03-15 2020-12-01 Auris Health, Inc. User input devices for controlling manipulation of guidewires and catheters
US9283046B2 (en) 2013-03-15 2016-03-15 Hansen Medical, Inc. User interface for active drive apparatus with finite range of motion
US11020016B2 (en) 2013-05-30 2021-06-01 Auris Health, Inc. System and method for displaying anatomy and devices on a movable display
EP2923669B1 (en) 2014-03-24 2017-06-28 Hansen Medical, Inc. Systems and devices for catheter driving instinctiveness
US11037464B2 (en) 2016-07-21 2021-06-15 Auris Health, Inc. System with emulator movement tracking for controlling medical devices
US10010379B1 (en) 2017-02-21 2018-07-03 Novarad Corporation Augmented reality viewing and tagging for medical procedures
US10835153B2 (en) * 2017-12-08 2020-11-17 Auris Health, Inc. System and method for medical instrument navigation and targeting
US10573023B2 (en) * 2018-04-09 2020-02-25 Globus Medical, Inc. Predictive visualization of medical imaging scanner component movement
US10861603B2 (en) * 2018-05-07 2020-12-08 Medtronic Minimed, Inc. Proactive image-based infusion device delivery adjustments
CN112218595A (zh) 2018-05-18 2021-01-12 奥瑞斯健康公司 用于机器人使能的远程操作的系统的控制器
US12144136B2 (en) 2018-09-07 2024-11-12 Cilag Gmbh International Modular surgical energy system with module positional awareness with digital logic
US11804679B2 (en) 2018-09-07 2023-10-31 Cilag Gmbh International Flexible hand-switch circuit
US11998258B2 (en) 2018-09-07 2024-06-04 Cilag Gmbh International Energy module for driving multiple energy modalities
US11696789B2 (en) 2018-09-07 2023-07-11 Cilag Gmbh International Consolidated user interface for modular energy system
US11923084B2 (en) 2018-09-07 2024-03-05 Cilag Gmbh International First and second communication protocol arrangement for driving primary and secondary devices through a single port
US20210225502A1 (en) * 2018-10-12 2021-07-22 Sony Corporation An operating room control system, method, and program
US11287874B2 (en) * 2018-11-17 2022-03-29 Novarad Corporation Using optical codes with augmented reality displays
CN114025700B (zh) 2019-06-28 2025-02-25 奥瑞斯健康公司 控制台叠加以及其使用方法
USD939545S1 (en) 2019-09-05 2021-12-28 Cilag Gmbh International Display panel or portion thereof with graphical user interface for energy module
EP3838209A1 (en) * 2019-12-20 2021-06-23 Koninklijke Philips N.V. Generating interactive zones for interventional medical devices
US11237627B2 (en) 2020-01-16 2022-02-01 Novarad Corporation Alignment of medical images in augmented reality displays
EP4107751A1 (en) 2020-02-18 2022-12-28 Koninklijke Philips N.V. Medical imaging systems, devices, and methods for visualizing a deployment state of an intracorporeal therapeutic device
US12016633B2 (en) 2020-12-30 2024-06-25 Novarad Corporation Alignment of medical images in augmented reality displays
US11857252B2 (en) 2021-03-30 2024-01-02 Cilag Gmbh International Bezel with light blocking features for modular energy system
US12235697B2 (en) 2021-03-30 2025-02-25 Cilag Gmbh International Backplane connector attachment mechanism for modular energy system
US11978554B2 (en) 2021-03-30 2024-05-07 Cilag Gmbh International Radio frequency identification token for wireless surgical instruments
US11968776B2 (en) 2021-03-30 2024-04-23 Cilag Gmbh International Method for mechanical packaging for modular energy system
US12040749B2 (en) 2021-03-30 2024-07-16 Cilag Gmbh International Modular energy system with dual amplifiers and techniques for updating parameters thereof
US12228987B2 (en) 2021-03-30 2025-02-18 Cilag Gmbh International Method for energy delivery for modular energy system
US11950860B2 (en) 2021-03-30 2024-04-09 Cilag Gmbh International User interface mitigation techniques for modular energy systems
US12369994B2 (en) 2021-03-30 2025-07-29 Cilag Gmbh International Modular energy system with multi-energy port splitter for multiple energy devices
US12004824B2 (en) 2021-03-30 2024-06-11 Cilag Gmbh International Architecture for modular energy system
US11980411B2 (en) 2021-03-30 2024-05-14 Cilag Gmbh International Header for modular energy system
US11963727B2 (en) 2021-03-30 2024-04-23 Cilag Gmbh International Method for system architecture for modular energy system
US12444094B2 (en) 2021-04-14 2025-10-14 Cilag Gmbh International Systems and methods for controlling surgical data overlay
US12106161B2 (en) 2021-11-02 2024-10-01 International Business Machines Corporation Augmented reality object interaction and notification
US11948265B2 (en) 2021-11-27 2024-04-02 Novarad Corporation Image data set alignment for an AR headset using anatomic structures and data fitting
US12079460B2 (en) 2022-06-28 2024-09-03 Cilag Gmbh International Profiles for modular energy system
US12324691B2 (en) 2022-11-18 2025-06-10 GE Precision Healthcare LLC Cone beam computed tomography centering with augmented reality

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014120006A (ja) 2012-12-17 2014-06-30 Haruyuki Iwata 携帯型移動支援装置
JP2014155207A (ja) 2013-02-14 2014-08-25 Seiko Epson Corp 頭部装着型表示装置および頭部装着型表示装置の制御方法
US20150363979A1 (en) 2013-02-14 2015-12-17 Seiko Epson Corporation Head mounted display and control method for head mounted display

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104272868A (zh) * 2011-12-05 2015-01-07 高通股份有限公司 远程医疗无线通信集线器设备和服务平台系统
CN104470458B (zh) * 2012-07-17 2017-06-16 皇家飞利浦有限公司 用于手术仪器引导的增强现实成像系统
WO2014030092A1 (en) * 2012-08-22 2014-02-27 Koninklijke Philips N.V. Automatic detection and retrieval of prior annotations relevant for an imaging study for efficient viewing and reporting
KR20140112207A (ko) 2013-03-13 2014-09-23 삼성전자주식회사 증강현실 영상 표시 시스템 및 이를 포함하는 수술 로봇 시스템
DE102014206004A1 (de) * 2014-03-31 2015-10-01 Siemens Aktiengesellschaft Triangulationsbasierte Tiefen- und Oberflächen-Visualisierung
US9696210B2 (en) 2014-06-16 2017-07-04 Honeywell International Inc. Extended temperature range mapping process of a furnace enclosure using various device settings
EP2982415A1 (en) 2014-08-04 2016-02-10 Université de Strasbourg Method for estimating the spatial distribution of the hazardousness of radiation doses
US10154239B2 (en) * 2014-12-30 2018-12-11 Onpoint Medical, Inc. Image-guided surgery with surface reconstruction and augmented reality visualization
KR101647467B1 (ko) 2015-06-05 2016-08-11 주식회사 메드릭스 증강현실을 이용한 외과 수술용 3d 안경 시스템
US10706626B1 (en) * 2015-12-09 2020-07-07 Roger Brent Augmented reality procedural system
DE102015226669B4 (de) * 2015-12-23 2022-07-28 Siemens Healthcare Gmbh Verfahren und System zum Ausgeben einer Erweiterte-Realität-Information

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014120006A (ja) 2012-12-17 2014-06-30 Haruyuki Iwata 携帯型移動支援装置
JP2014155207A (ja) 2013-02-14 2014-08-25 Seiko Epson Corp 頭部装着型表示装置および頭部装着型表示装置の制御方法
US20150363979A1 (en) 2013-02-14 2015-12-17 Seiko Epson Corporation Head mounted display and control method for head mounted display

Also Published As

Publication number Publication date
WO2018134140A1 (en) 2018-07-26
US20250061617A1 (en) 2025-02-20
US20190371012A1 (en) 2019-12-05
CN110199357A (zh) 2019-09-03
JP2020510461A (ja) 2020-04-09
CN110199357B (zh) 2023-07-14
US12169881B2 (en) 2024-12-17
US11551380B2 (en) 2023-01-10
EP3571698A1 (en) 2019-11-27
US20230086592A1 (en) 2023-03-23

Similar Documents

Publication Publication Date Title
JP7146772B2 (ja) コンテクストオーバレイを提供する拡張現実インターベンションシステム
JP7004729B2 (ja) 手術室における予測ワークフローのための拡張現実
US11069146B2 (en) Augmented reality for collaborative interventions
US10403402B2 (en) Methods and systems for accessing and manipulating images comprising medically relevant information with 3D gestures
EP2866667B1 (en) C-arm trajectory planning for optimal image acquisition in endoscopic surgery
EP3380031B1 (en) Method and system for interacting with medical information
EP3570771B1 (en) Augmented reality for radiation dose monitoring
US11740757B2 (en) Virtual cover for user interaction in augmented reality
EP2830506B1 (en) Direct control of x-ray focal spot movement
US20140372136A1 (en) Method and apparatus for providing medical information
US20070182729A1 (en) Apparatus for interventional therapy
US12026837B2 (en) Adapting an augmented and/or virtual reality
CN112397189A (zh) 一种医用导引装置及其使用方法
JP2014113325A (ja) 画像表示装置及び医用画像診断装置

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201221

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20201221

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20211126

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20211130

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20220225

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20220526

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220915

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220921

R150 Certificate of patent or registration of utility model

Ref document number: 7146772

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250