CN115715386A - 用于查看3d或4d医学图像数据的基于扩展现实的用户接口附加组件、系统和方法 - Google Patents

用于查看3d或4d医学图像数据的基于扩展现实的用户接口附加组件、系统和方法 Download PDF

Info

Publication number
CN115715386A
CN115715386A CN202180045348.0A CN202180045348A CN115715386A CN 115715386 A CN115715386 A CN 115715386A CN 202180045348 A CN202180045348 A CN 202180045348A CN 115715386 A CN115715386 A CN 115715386A
Authority
CN
China
Prior art keywords
user interface
content
processing module
data
add
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202180045348.0A
Other languages
English (en)
Chinese (zh)
Inventor
M·史瑞克恩伯格
M·布兰肯哈根
N·D·M·黑楚里奇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of CN115715386A publication Critical patent/CN115715386A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30048—Heart; Cardiac
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/41—Medical

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Epidemiology (AREA)
  • Geometry (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Quality & Reliability (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
CN202180045348.0A 2020-06-23 2021-06-16 用于查看3d或4d医学图像数据的基于扩展现实的用户接口附加组件、系统和方法 Pending CN115715386A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP20181714.5A EP3929702A1 (en) 2020-06-23 2020-06-23 Extended reality-based user interface add-on, system and method for reviewing 3d or 4d medical image data
EP20181714.5 2020-06-23
PCT/EP2021/066205 WO2021259724A1 (en) 2020-06-23 2021-06-16 Extended reality-based user interface add-on, system and method for reviewing 3d or 4d medical image data

Publications (1)

Publication Number Publication Date
CN115715386A true CN115715386A (zh) 2023-02-24

Family

ID=71143502

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180045348.0A Pending CN115715386A (zh) 2020-06-23 2021-06-16 用于查看3d或4d医学图像数据的基于扩展现实的用户接口附加组件、系统和方法

Country Status (6)

Country Link
US (1) US20230230321A1 (https=)
EP (2) EP3929702A1 (https=)
JP (1) JP2023530895A (https=)
CN (1) CN115715386A (https=)
CA (1) CA3187782A1 (https=)
WO (1) WO2021259724A1 (https=)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115668390A (zh) 2020-05-29 2023-01-31 美敦力公司 用于心脏分流手术的扩展现实(xr)应用
US12558167B2 (en) * 2021-05-12 2026-02-24 Medtronic, Inc. Extended intelligence for cardiac implantable electronic device (CIED) placement procedures
US12347124B2 (en) 2022-11-15 2025-07-01 Adobe Inc. Generating adaptive three-dimensional meshes of two-dimensional images
US12307600B2 (en) 2022-11-15 2025-05-20 Adobe Inc. Modifying two-dimensional images utilizing iterative three-dimensional meshes of the two-dimensional images
US12469194B2 (en) 2022-10-03 2025-11-11 Adobe Inc. Generating shadows for placed objects in depth estimated scenes of two-dimensional images
US12277652B2 (en) 2022-11-15 2025-04-15 Adobe Inc. Modifying two-dimensional images utilizing segmented three-dimensional object meshes of the two-dimensional images
US12482172B2 (en) 2022-10-03 2025-11-25 Adobe Inc. Generating shadows for objects in two-dimensional images utilizing a plurality of shadow maps
US12367626B2 (en) 2022-11-15 2025-07-22 Adobe Inc. Modifying two-dimensional images utilizing three-dimensional meshes of the two-dimensional images
US12499574B2 (en) 2022-10-06 2025-12-16 Adobe Inc. Generating three-dimensional human models representing two-dimensional humans in two-dimensional images
US12394166B2 (en) * 2022-10-06 2025-08-19 Adobe Inc. Modifying poses of two-dimensional humans in two-dimensional images by reposing three-dimensional human models representing the two-dimensional humans
US12423855B2 (en) 2023-04-20 2025-09-23 Adobe Inc. Generating modified two-dimensional images by customizing focal points via three-dimensional representations of the two-dimensional images

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102566756A (zh) * 2010-12-16 2012-07-11 微软公司 用于扩展现实显示的基于理解力和意图的内容
CN107688348A (zh) * 2017-08-10 2018-02-13 中国科学院半导体研究所 一种实现指向控制功能的无线人机交互设备和方法
US20180075654A1 (en) * 2016-09-12 2018-03-15 Intel Corporation Hybrid rendering for a wearable display attached to a tethered computer
CN110050290A (zh) * 2017-01-05 2019-07-23 三星电子株式会社 虚拟现实体验共享
US20190356894A1 (en) * 2017-01-20 2019-11-21 Pcms Holdings, Inc. Field-of-view prediction method based on contextual information for 360-degree vr video
US20190380792A1 (en) * 2018-06-19 2019-12-19 Tornier, Inc. Virtual guidance for orthopedic surgical procedures

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6613652B2 (ja) * 2015-06-23 2019-12-04 キヤノンマーケティングジャパン株式会社 医用画像処理システム、医用画像処理システムの制御方法、医用画像処理装置、及びプログラム
CN114903591B (zh) * 2016-03-21 2026-03-24 华盛顿大学 3d医学图像的虚拟现实或增强现实可视化
US10010379B1 (en) * 2017-02-21 2018-07-03 Novarad Corporation Augmented reality viewing and tagging for medical procedures
EP3731896B1 (en) * 2017-12-01 2024-02-28 Sanofi Sensor system
US10802894B2 (en) * 2018-03-30 2020-10-13 Inflight VR Software GmbH Method, apparatus, and computer-readable medium for managing notifications delivered to a virtual reality device
JP7391348B2 (ja) * 2018-06-26 2023-12-05 株式会社根本杏林堂 医用画像処理システム、医用画像処理方法および医用画像処理プログラム
IL280460B2 (en) * 2018-07-29 2025-04-01 Nano X Ai Ltd Systems and methods for automatic recognition of visual objects in medical images
JP6508860B1 (ja) * 2018-08-22 2019-05-08 株式会社アールピージー・ラボ アドオン型制御器および制御システム

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102566756A (zh) * 2010-12-16 2012-07-11 微软公司 用于扩展现实显示的基于理解力和意图的内容
US20180075654A1 (en) * 2016-09-12 2018-03-15 Intel Corporation Hybrid rendering for a wearable display attached to a tethered computer
CN110050290A (zh) * 2017-01-05 2019-07-23 三星电子株式会社 虚拟现实体验共享
US20190356894A1 (en) * 2017-01-20 2019-11-21 Pcms Holdings, Inc. Field-of-view prediction method based on contextual information for 360-degree vr video
CN107688348A (zh) * 2017-08-10 2018-02-13 中国科学院半导体研究所 一种实现指向控制功能的无线人机交互设备和方法
US20190380792A1 (en) * 2018-06-19 2019-12-19 Tornier, Inc. Virtual guidance for orthopedic surgical procedures

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
ALEXANDER BORNIK ET AL.: "A Hybrid User Interface for Manipulation of Volumetric Medical Data", 3D USER INTERFACES, 31 December 2006 (2006-12-31), pages 3 - 6 *

Also Published As

Publication number Publication date
JP2023530895A (ja) 2023-07-20
EP4168880A1 (en) 2023-04-26
US20230230321A1 (en) 2023-07-20
EP3929702A1 (en) 2021-12-29
WO2021259724A1 (en) 2021-12-30
CA3187782A1 (en) 2021-12-30

Similar Documents

Publication Publication Date Title
CN115715386A (zh) 用于查看3d或4d医学图像数据的基于扩展现实的用户接口附加组件、系统和方法
Chheang et al. A collaborative virtual reality environment for liver surgery planning
JP7624975B2 (ja) 仮想マルチユーザコラボレーションにおいて医用画像データを分析するための方法、コンピュータプログラム、ユーザインターフェース、およびシステム
JP6883177B2 (ja) 解剖学的アイテムのコンピュータによる視覚化
US11416069B2 (en) Device and system for volume visualization and interaction in a virtual reality or augmented reality environment
US12186022B2 (en) Device and system for multidimensional data visualization and interaction in an augmented reality virtual reality or mixed reality image guided surgery
US20220346888A1 (en) Device and system for multidimensional data visualization and interaction in an augmented reality virtual reality or mixed reality environment
Pires et al. On the use of virtual reality for medical imaging visualization
JP2025084740A (ja) 動的解剖学的構造を視覚化する方法
US10872460B1 (en) Device and system for volume visualization and interaction in a virtual reality or augmented reality environment
CN118043851A (zh) 分析3d医学图像数据的方法、计算机程序和3d医学图像数据评估装置
Allison et al. MIXR: a standard architecture for medical image analysis in augmented and mixed reality
Shen et al. Medvis: A real-time immersive visualization environment for the exploration of medical volumetric data
Fischer Rendering methods for augmented reality
Williams A method for viewing and interacting with medical volumes in virtual reality
US20260076754A1 (en) System and method for rendering operative guidance overlay
Grandi et al. Spatially aware mobile interface for 3d visualization and interactive surgery planning
Hoffensetz et al. Volume visulization of medical scans in virtual reality

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination