CN110199357B - 提供背景叠加的增强现实介入系统 - Google Patents

提供背景叠加的增强现实介入系统 Download PDF

Info

Publication number
CN110199357B
CN110199357B CN201880007343.7A CN201880007343A CN110199357B CN 110199357 B CN110199357 B CN 110199357B CN 201880007343 A CN201880007343 A CN 201880007343A CN 110199357 B CN110199357 B CN 110199357B
Authority
CN
China
Prior art keywords
user
overlay
graphics processing
processing module
background overlay
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880007343.7A
Other languages
English (en)
Chinese (zh)
Other versions
CN110199357A (zh
Inventor
M·L·弗莱克斯曼
A·波波维奇
A·潘斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of CN110199357A publication Critical patent/CN110199357A/zh
Application granted granted Critical
Publication of CN110199357B publication Critical patent/CN110199357B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/25—User interfaces for surgical systems
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G09B19/003—Repetitive work cycles; Sequence of movements
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/25—User interfaces for surgical systems
    • A61B2034/252—User interfaces for surgical systems indicating steps of a surgical procedure
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B2090/364—Correlation of different images or relation of image positions in respect to the body
    • A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/36—Image-producing devices or illumination devices not otherwise provided for
    • A61B90/37—Surgical systems with images on a monitor during operation
    • A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
    • A61B2090/3762—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy using computed tomography systems [CT]
    • A61B2090/3764—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy using computed tomography systems [CT] with a rotating C-arm having a cone beam emitting source
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/41—Medical

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Business, Economics & Management (AREA)
  • Medical Informatics (AREA)
  • Public Health (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Molecular Biology (AREA)
  • Educational Administration (AREA)
  • Animal Behavior & Ethology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Educational Technology (AREA)
  • General Business, Economics & Management (AREA)
  • Gynecology & Obstetrics (AREA)
  • Human Computer Interaction (AREA)
  • Robotics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Pathology (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • User Interface Of Digital Computer (AREA)
  • Medical Treatment And Welfare Office Work (AREA)
CN201880007343.7A 2017-01-17 2018-01-15 提供背景叠加的增强现实介入系统 Active CN110199357B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201762447069P 2017-01-17 2017-01-17
US62/447,069 2017-01-17
PCT/EP2018/050806 WO2018134140A1 (en) 2017-01-17 2018-01-15 Augmented reality interventional system providing contextual overlays

Publications (2)

Publication Number Publication Date
CN110199357A CN110199357A (zh) 2019-09-03
CN110199357B true CN110199357B (zh) 2023-07-14

Family

ID=61163661

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880007343.7A Active CN110199357B (zh) 2017-01-17 2018-01-15 提供背景叠加的增强现实介入系统

Country Status (5)

Country Link
US (3) US11551380B2 (https=)
EP (1) EP3571698A1 (https=)
JP (1) JP7146772B2 (https=)
CN (1) CN110199357B (https=)
WO (1) WO2018134140A1 (https=)

Families Citing this family (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9566414B2 (en) 2013-03-13 2017-02-14 Hansen Medical, Inc. Integrated catheter and guide wire controller
US9283046B2 (en) 2013-03-15 2016-03-15 Hansen Medical, Inc. User interface for active drive apparatus with finite range of motion
US10849702B2 (en) 2013-03-15 2020-12-01 Auris Health, Inc. User input devices for controlling manipulation of guidewires and catheters
US11020016B2 (en) 2013-05-30 2021-06-01 Auris Health, Inc. System and method for displaying anatomy and devices on a movable display
EP3243476B1 (en) 2014-03-24 2019-11-06 Auris Health, Inc. Systems and devices for catheter driving instinctiveness
US11037464B2 (en) 2016-07-21 2021-06-15 Auris Health, Inc. System with emulator movement tracking for controlling medical devices
US10010379B1 (en) 2017-02-21 2018-07-03 Novarad Corporation Augmented reality viewing and tagging for medical procedures
KR20200099138A (ko) 2017-12-08 2020-08-21 아우리스 헬스, 인코포레이티드 의료 기구 항행 및 표적 선정을 위한 시스템 및 방법
US10573023B2 (en) * 2018-04-09 2020-02-25 Globus Medical, Inc. Predictive visualization of medical imaging scanner component movement
US20190341149A1 (en) * 2018-05-07 2019-11-07 Medtronic Minimed, Inc. Augmented reality guidance for medical devices
EP3793465A4 (en) 2018-05-18 2022-03-02 Auris Health, Inc. CONTROL DEVICES FOR ROBOTIC ACTIVATION REMOTE CONTROL SYSTEMS
US12144136B2 (en) 2018-09-07 2024-11-12 Cilag Gmbh International Modular surgical energy system with module positional awareness with digital logic
US11471206B2 (en) 2018-09-07 2022-10-18 Cilag Gmbh International Method for controlling a modular energy system user interface
US11923084B2 (en) 2018-09-07 2024-03-05 Cilag Gmbh International First and second communication protocol arrangement for driving primary and secondary devices through a single port
US12035956B2 (en) 2018-09-07 2024-07-16 Cilag Gmbh International Instrument tracking arrangement based on real time clock information
US11804679B2 (en) 2018-09-07 2023-10-31 Cilag Gmbh International Flexible hand-switch circuit
EP3850636B1 (en) * 2018-10-12 2024-04-03 Sony Group Corporation An operating room control system, method, and program
US11287874B2 (en) * 2018-11-17 2022-03-29 Novarad Corporation Using optical codes with augmented reality displays
US11872007B2 (en) 2019-06-28 2024-01-16 Auris Health, Inc. Console overlay and methods of using same
USD939545S1 (en) 2019-09-05 2021-12-28 Cilag Gmbh International Display panel or portion thereof with graphical user interface for energy module
EP3838209A1 (en) * 2019-12-20 2021-06-23 Koninklijke Philips N.V. Generating interactive zones for interventional medical devices
US11237627B2 (en) 2020-01-16 2022-02-01 Novarad Corporation Alignment of medical images in augmented reality displays
JP7809063B2 (ja) 2020-02-18 2026-01-30 コーニンクレッカ フィリップス エヌ ヴェ 体内治療デバイスの展開状態を視覚化する医用画像化システム、デバイス、及び方法
EP3944834A1 (en) * 2020-07-30 2022-02-02 Koninklijke Philips N.V. Navigation operation instructions
US12016633B2 (en) 2020-12-30 2024-06-25 Novarad Corporation Alignment of medical images in augmented reality displays
US11978554B2 (en) 2021-03-30 2024-05-07 Cilag Gmbh International Radio frequency identification token for wireless surgical instruments
US12235697B2 (en) 2021-03-30 2025-02-25 Cilag Gmbh International Backplane connector attachment mechanism for modular energy system
US11857252B2 (en) 2021-03-30 2024-01-02 Cilag Gmbh International Bezel with light blocking features for modular energy system
US11980411B2 (en) 2021-03-30 2024-05-14 Cilag Gmbh International Header for modular energy system
US12228987B2 (en) 2021-03-30 2025-02-18 Cilag Gmbh International Method for energy delivery for modular energy system
US12004824B2 (en) 2021-03-30 2024-06-11 Cilag Gmbh International Architecture for modular energy system
US11963727B2 (en) 2021-03-30 2024-04-23 Cilag Gmbh International Method for system architecture for modular energy system
US11950860B2 (en) 2021-03-30 2024-04-09 Cilag Gmbh International User interface mitigation techniques for modular energy systems
US12369994B2 (en) 2021-03-30 2025-07-29 Cilag Gmbh International Modular energy system with multi-energy port splitter for multiple energy devices
US11968776B2 (en) 2021-03-30 2024-04-23 Cilag Gmbh International Method for mechanical packaging for modular energy system
US12040749B2 (en) 2021-03-30 2024-07-16 Cilag Gmbh International Modular energy system with dual amplifiers and techniques for updating parameters thereof
US12354186B2 (en) 2021-04-14 2025-07-08 Cilag Gmbh International Customization of overlaid data and configuration
US12106161B2 (en) 2021-11-02 2024-10-01 International Business Machines Corporation Augmented reality object interaction and notification
US11948265B2 (en) 2021-11-27 2024-04-02 Novarad Corporation Image data set alignment for an AR headset using anatomic structures and data fitting
WO2023110088A1 (en) * 2021-12-15 2023-06-22 Brainlab Ag Computer-implemented method for use in aligning pieces of equipment of a medical system
US12079460B2 (en) 2022-06-28 2024-09-03 Cilag Gmbh International Profiles for modular energy system
US12324691B2 (en) 2022-11-18 2025-06-10 GE Precision Healthcare LLC Cone beam computed tomography centering with augmented reality
EP4481259A1 (de) * 2023-06-22 2024-12-25 Leuze electronic GmbH + Co. KG Überwachungsvorrichtung

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104272868A (zh) * 2011-12-05 2015-01-07 高通股份有限公司 远程医疗无线通信集线器设备和服务平台系统
CN104584018A (zh) * 2012-08-22 2015-04-29 皇家飞利浦有限公司 用于有效查看和报告成像研究相关的先前注释的自动检测和检索

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10610172B2 (en) * 2012-07-17 2020-04-07 Koninklijke Philips N.V. Imaging system and method for enabling instrument guidance
JP6299067B2 (ja) * 2013-02-14 2018-03-28 セイコーエプソン株式会社 頭部装着型表示装置および頭部装着型表示装置の制御方法
WO2014125789A1 (en) * 2013-02-14 2014-08-21 Seiko Epson Corporation Head mounted display and control method for head mounted display
KR20140112207A (ko) 2013-03-13 2014-09-23 삼성전자주식회사 증강현실 영상 표시 시스템 및 이를 포함하는 수술 로봇 시스템
DE102014206004A1 (de) * 2014-03-31 2015-10-01 Siemens Aktiengesellschaft Triangulationsbasierte Tiefen- und Oberflächen-Visualisierung
US9696210B2 (en) 2014-06-16 2017-07-04 Honeywell International Inc. Extended temperature range mapping process of a furnace enclosure using various device settings
EP2982415A1 (en) * 2014-08-04 2016-02-10 Université de Strasbourg Method for estimating the spatial distribution of the hazardousness of radiation doses
US10154239B2 (en) 2014-12-30 2018-12-11 Onpoint Medical, Inc. Image-guided surgery with surface reconstruction and augmented reality visualization
KR101647467B1 (ko) 2015-06-05 2016-08-11 주식회사 메드릭스 증강현실을 이용한 외과 수술용 3d 안경 시스템
US10706626B1 (en) * 2015-12-09 2020-07-07 Roger Brent Augmented reality procedural system
DE102015226669B4 (de) * 2015-12-23 2022-07-28 Siemens Healthcare Gmbh Verfahren und System zum Ausgeben einer Erweiterte-Realität-Information

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104272868A (zh) * 2011-12-05 2015-01-07 高通股份有限公司 远程医疗无线通信集线器设备和服务平台系统
CN104584018A (zh) * 2012-08-22 2015-04-29 皇家飞利浦有限公司 用于有效查看和报告成像研究相关的先前注释的自动检测和检索

Also Published As

Publication number Publication date
CN110199357A (zh) 2019-09-03
JP2020510461A (ja) 2020-04-09
US12169881B2 (en) 2024-12-17
US20250061617A1 (en) 2025-02-20
WO2018134140A1 (en) 2018-07-26
US20190371012A1 (en) 2019-12-05
JP7146772B2 (ja) 2022-10-04
US20230086592A1 (en) 2023-03-23
US11551380B2 (en) 2023-01-10
EP3571698A1 (en) 2019-11-27

Similar Documents

Publication Publication Date Title
CN110199357B (zh) 提供背景叠加的增强现实介入系统
JP7004729B2 (ja) 手術室における予測ワークフローのための拡張現実
EP2866667B1 (en) C-arm trajectory planning for optimal image acquisition in endoscopic surgery
CN104244833B (zh) X射线焦斑移动的方向控制
CN110225719B (zh) 用于辐射剂量监测的增强现实
CN106687046A (zh) 用于定位进行医学成像的患者的引导系统
CN115804652B (zh) 手术操作系统及方法
EP3890610B1 (en) Positioning a medical x-ray imaging apparatus
CN105266831A (zh) 对x光源的调节变量进行姿势控制的调节的设备和方法
JP2015535722A (ja) カテーテルのためのｘ線撮像システム
CN112397189A (zh) 一种医用导引装置及其使用方法
US12026837B2 (en) Adapting an augmented and/or virtual reality
JP6824595B2 (ja) Ｘ線診断装置および医用画像診断装置
KR20150113490A (ko) 의료 영상 판독을 지원하기 위한 가상 사용자 인터페이스 장치 및 가상 사용자 인터페이스 제공 방법
KR20150113940A (ko) 의료 영상 판독을 지원하기 위한 가상 사용자 인터페이스 장치 및 가상 사용자 인터페이스 제공 방법
JP6245801B2 (ja) 画像表示装置及び医用画像診断装置

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant