CA3187782A1 - Extended reality-based user interface add-on, system and method for reviewing 3d or 4d medical image data - Google Patents

Extended reality-based user interface add-on, system and method for reviewing 3d or 4d medical image data

Info

Publication number
CA3187782A1
CA3187782A1 CA3187782A CA3187782A CA3187782A1 CA 3187782 A1 CA3187782 A1 CA 3187782A1 CA 3187782 A CA3187782 A CA 3187782A CA 3187782 A CA3187782 A CA 3187782A CA 3187782 A1 CA3187782 A1 CA 3187782A1
Authority
CA
Canada
Prior art keywords
user interface
content
processing module
extended reality
dataset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CA3187782A
Other languages
English (en)
French (fr)
Inventor
Marcus Schreckenberg
Michael BLANKENHAGEN
Niklas Domenic Maria Hitschrich
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of CA3187782A1 publication Critical patent/CA3187782A1/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30048—Heart; Cardiac
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/41—Medical

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Epidemiology (AREA)
  • Geometry (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Quality & Reliability (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
CA3187782A 2020-06-23 2021-06-16 Extended reality-based user interface add-on, system and method for reviewing 3d or 4d medical image data Pending CA3187782A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP20181714.5A EP3929702A1 (en) 2020-06-23 2020-06-23 Extended reality-based user interface add-on, system and method for reviewing 3d or 4d medical image data
EP20181714.5 2020-06-23
PCT/EP2021/066205 WO2021259724A1 (en) 2020-06-23 2021-06-16 Extended reality-based user interface add-on, system and method for reviewing 3d or 4d medical image data

Publications (1)

Publication Number Publication Date
CA3187782A1 true CA3187782A1 (en) 2021-12-30

Family

ID=71143502

Family Applications (1)

Application Number Title Priority Date Filing Date
CA3187782A Pending CA3187782A1 (en) 2020-06-23 2021-06-16 Extended reality-based user interface add-on, system and method for reviewing 3d or 4d medical image data

Country Status (6)

Country Link
US (1) US20230230321A1 (https=)
EP (2) EP3929702A1 (https=)
JP (1) JP2023530895A (https=)
CN (1) CN115715386A (https=)
CA (1) CA3187782A1 (https=)
WO (1) WO2021259724A1 (https=)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115668390A (zh) 2020-05-29 2023-01-31 美敦力公司 用于心脏分流手术的扩展现实(xr)应用
US12558167B2 (en) * 2021-05-12 2026-02-24 Medtronic, Inc. Extended intelligence for cardiac implantable electronic device (CIED) placement procedures
US12347124B2 (en) 2022-11-15 2025-07-01 Adobe Inc. Generating adaptive three-dimensional meshes of two-dimensional images
US12307600B2 (en) 2022-11-15 2025-05-20 Adobe Inc. Modifying two-dimensional images utilizing iterative three-dimensional meshes of the two-dimensional images
US12469194B2 (en) 2022-10-03 2025-11-11 Adobe Inc. Generating shadows for placed objects in depth estimated scenes of two-dimensional images
US12277652B2 (en) 2022-11-15 2025-04-15 Adobe Inc. Modifying two-dimensional images utilizing segmented three-dimensional object meshes of the two-dimensional images
US12482172B2 (en) 2022-10-03 2025-11-25 Adobe Inc. Generating shadows for objects in two-dimensional images utilizing a plurality of shadow maps
US12367626B2 (en) 2022-11-15 2025-07-22 Adobe Inc. Modifying two-dimensional images utilizing three-dimensional meshes of the two-dimensional images
US12499574B2 (en) 2022-10-06 2025-12-16 Adobe Inc. Generating three-dimensional human models representing two-dimensional humans in two-dimensional images
US12394166B2 (en) * 2022-10-06 2025-08-19 Adobe Inc. Modifying poses of two-dimensional humans in two-dimensional images by reposing three-dimensional human models representing the two-dimensional humans
US12423855B2 (en) 2023-04-20 2025-09-23 Adobe Inc. Generating modified two-dimensional images by customizing focal points via three-dimensional representations of the two-dimensional images

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9213405B2 (en) * 2010-12-16 2015-12-15 Microsoft Technology Licensing, Llc Comprehension and intent-based content for augmented reality displays
JP6613652B2 (ja) * 2015-06-23 2019-12-04 キヤノンマーケティングジャパン株式会社 医用画像処理システム、医用画像処理システムの制御方法、医用画像処理装置、及びプログラム
CN114903591B (zh) * 2016-03-21 2026-03-24 华盛顿大学 3d医学图像的虚拟现实或增强现实可视化
US9928660B1 (en) * 2016-09-12 2018-03-27 Intel Corporation Hybrid rendering for a wearable display attached to a tethered computer
US10769797B2 (en) * 2017-01-05 2020-09-08 Samsung Electronics Co., Ltd. Virtual reality experience sharing
US10863159B2 (en) * 2017-01-20 2020-12-08 Pcms Holdings, Inc. Field-of-view prediction method based on contextual information for 360-degree VR video
US10010379B1 (en) * 2017-02-21 2018-07-03 Novarad Corporation Augmented reality viewing and tagging for medical procedures
CN107688348B (zh) * 2017-08-10 2020-10-20 中国科学院半导体研究所 一种实现指向控制功能的无线人机交互设备和方法
EP3731896B1 (en) * 2017-12-01 2024-02-28 Sanofi Sensor system
US10802894B2 (en) * 2018-03-30 2020-10-13 Inflight VR Software GmbH Method, apparatus, and computer-readable medium for managing notifications delivered to a virtual reality device
WO2019245862A1 (en) * 2018-06-19 2019-12-26 Tornier, Inc. Visualization of intraoperatively modified surgical plans
JP7391348B2 (ja) * 2018-06-26 2023-12-05 株式会社根本杏林堂 医用画像処理システム、医用画像処理方法および医用画像処理プログラム
IL280460B2 (en) * 2018-07-29 2025-04-01 Nano X Ai Ltd Systems and methods for automatic recognition of visual objects in medical images
JP6508860B1 (ja) * 2018-08-22 2019-05-08 株式会社アールピージー・ラボ アドオン型制御器および制御システム

Also Published As

Publication number Publication date
JP2023530895A (ja) 2023-07-20
EP4168880A1 (en) 2023-04-26
US20230230321A1 (en) 2023-07-20
EP3929702A1 (en) 2021-12-29
WO2021259724A1 (en) 2021-12-30
CN115715386A (zh) 2023-02-24

Similar Documents

Publication Publication Date Title
US20230230321A1 (en) Extended reality-based user interface add-on, system and method for reviewing 3d or 4d medical image data
JP7624975B2 (ja) 仮想マルチユーザコラボレーションにおいて医用画像データを分析するための方法、コンピュータプログラム、ユーザインターフェース、およびシステム
Chheang et al. A collaborative virtual reality environment for liver surgery planning
US11416069B2 (en) Device and system for volume visualization and interaction in a virtual reality or augmented reality environment
US12186022B2 (en) Device and system for multidimensional data visualization and interaction in an augmented reality virtual reality or mixed reality image guided surgery
JP6883177B2 (ja) 解剖学的アイテムのコンピュータによる視覚化
EP3912139B1 (en) Method of visualising a dynamic anatomical structure
US20220346888A1 (en) Device and system for multidimensional data visualization and interaction in an augmented reality virtual reality or mixed reality environment
US10592067B2 (en) Distributed interactive medical visualization system with primary/secondary interaction features
US10872460B1 (en) Device and system for volume visualization and interaction in a virtual reality or augmented reality environment
US20190026935A1 (en) Method and system for providing virtual reality experience based on ultrasound data
US10585552B2 (en) Distributed interactive medical visualization system with user interface features
US20200205905A1 (en) Distributed interactive medical visualization system with user interface and primary/secondary interaction features
Fischer Rendering methods for augmented reality
KR20240163671A (ko) 환자의 3d 모델을 표시하기 위한 방법
Williams A method for viewing and interacting with medical volumes in virtual reality
US20260076754A1 (en) System and method for rendering operative guidance overlay
Bhat et al. Immersive Viewing of Dento-facial Medical Data in Virtual Reality
Grandi et al. Spatially aware mobile interface for 3d visualization and interactive surgery planning
JP7833617B2 (ja) セグメンテーションネットワーク同期のためのシステムおよび方法
US20250120816A1 (en) Systems and methods for generating patient-specific implants for anatomical structures of patients
Paulano et al. An application to interact with 3D models reconstructed from medical images
Hoffensetz et al. Volume visulization of medical scans in virtual reality
Hong et al. Virtual angioscopy based on implicit vasculatures

Legal Events

Date Code Title Description
U13 Renewal or maintenance fee not paid

Free format text: ST27 STATUS EVENT CODE: N-1-6-U10-U13-U300 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: DEEMED ABANDONED - FAILURE TO RESPOND TO MAINTENANCE FEE NOTICE

Effective date: 20260202

W00 Other event occurred

Free format text: ST27 STATUS EVENT CODE: A-1-1-W10-W00-W100 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: LETTER SENT

Effective date: 20260204