JP2023530895A - 拡張現実ベースのユーザインターフェースアドオン、３ｄ又は４ｄ医用画像データをレビューするためのシステム及び方法 - Google Patents

拡張現実ベースのユーザインターフェースアドオン、３ｄ又は４ｄ医用画像データをレビューするためのシステム及び方法 Download PDF

Info

Publication number
JP2023530895A
JP2023530895A JP2022575924A JP2022575924A JP2023530895A JP 2023530895 A JP2023530895 A JP 2023530895A JP 2022575924 A JP2022575924 A JP 2022575924A JP 2022575924 A JP2022575924 A JP 2022575924A JP 2023530895 A JP2023530895 A JP 2023530895A
Authority
JP
Japan
Prior art keywords
user interface
content
augmented reality
processing module
add
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2022575924A
Other languages
English (en)
Japanese (ja)
Other versions
JP2023530895A5 (https=
Inventor
マルクス スレッケンベルフ
ハヘン ミヒャエル ブランケン
ニクラス ドメニク マリア ヒツリッヒ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV filed Critical Koninklijke Philips NV
Publication of JP2023530895A publication Critical patent/JP2023530895A/ja
Publication of JP2023530895A5 publication Critical patent/JP2023530895A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10132—Ultrasound image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30048—Heart; Cardiac
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/41—Medical

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Epidemiology (AREA)
  • Geometry (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Quality & Reliability (AREA)
  • Computer Hardware Design (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
JP2022575924A 2020-06-23 2021-06-16 拡張現実ベースのユーザインターフェースアドオン、３ｄ又は４ｄ医用画像データをレビューするためのシステム及び方法 Pending JP2023530895A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP20181714.5A EP3929702A1 (en) 2020-06-23 2020-06-23 Extended reality-based user interface add-on, system and method for reviewing 3d or 4d medical image data
EP20181714.5 2020-06-23
PCT/EP2021/066205 WO2021259724A1 (en) 2020-06-23 2021-06-16 Extended reality-based user interface add-on, system and method for reviewing 3d or 4d medical image data

Publications (2)

Publication Number Publication Date
JP2023530895A true JP2023530895A (ja) 2023-07-20
JP2023530895A5 JP2023530895A5 (https=) 2024-06-18

Family

ID=71143502

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2022575924A Pending JP2023530895A (ja) 2020-06-23 2021-06-16 拡張現実ベースのユーザインターフェースアドオン、３ｄ又は４ｄ医用画像データをレビューするためのシステム及び方法

Country Status (6)

Country Link
US (1) US20230230321A1 (https=)
EP (2) EP3929702A1 (https=)
JP (1) JP2023530895A (https=)
CN (1) CN115715386A (https=)
CA (1) CA3187782A1 (https=)
WO (1) WO2021259724A1 (https=)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115668390A (zh) 2020-05-29 2023-01-31 美敦力公司 用于心脏分流手术的扩展现实(xr)应用
US12558167B2 (en) * 2021-05-12 2026-02-24 Medtronic, Inc. Extended intelligence for cardiac implantable electronic device (CIED) placement procedures
US12347124B2 (en) 2022-11-15 2025-07-01 Adobe Inc. Generating adaptive three-dimensional meshes of two-dimensional images
US12307600B2 (en) 2022-11-15 2025-05-20 Adobe Inc. Modifying two-dimensional images utilizing iterative three-dimensional meshes of the two-dimensional images
US12469194B2 (en) 2022-10-03 2025-11-11 Adobe Inc. Generating shadows for placed objects in depth estimated scenes of two-dimensional images
US12277652B2 (en) 2022-11-15 2025-04-15 Adobe Inc. Modifying two-dimensional images utilizing segmented three-dimensional object meshes of the two-dimensional images
US12482172B2 (en) 2022-10-03 2025-11-25 Adobe Inc. Generating shadows for objects in two-dimensional images utilizing a plurality of shadow maps
US12367626B2 (en) 2022-11-15 2025-07-22 Adobe Inc. Modifying two-dimensional images utilizing three-dimensional meshes of the two-dimensional images
US12499574B2 (en) 2022-10-06 2025-12-16 Adobe Inc. Generating three-dimensional human models representing two-dimensional humans in two-dimensional images
US12394166B2 (en) * 2022-10-06 2025-08-19 Adobe Inc. Modifying poses of two-dimensional humans in two-dimensional images by reposing three-dimensional human models representing the two-dimensional humans
US12423855B2 (en) 2023-04-20 2025-09-23 Adobe Inc. Generating modified two-dimensional images by customizing focal points via three-dimensional representations of the two-dimensional images

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017010330A (ja) * 2015-06-23 2017-01-12 キヤノンマーケティングジャパン株式会社 医用画像処理システム、医用画像処理装置、その制御方法、及びプログラム
WO2017165301A1 (en) * 2016-03-21 2017-09-28 Washington University Virtual reality or augmented reality visualization of 3d medical images
US20180075654A1 (en) * 2016-09-12 2018-03-15 Intel Corporation Hybrid rendering for a wearable display attached to a tethered computer
WO2019106014A1 (en) * 2017-12-01 2019-06-06 Sanofi Sensor system
WO2019185601A1 (en) * 2018-03-30 2019-10-03 Inflight VR Software GmbH Method, apparatus, and computer-readable medium for managing notifications delivered to a virtual reality device
US20190365498A1 (en) * 2017-02-21 2019-12-05 Novarad Corporation Augmented Reality Viewing and Tagging For Medical Procedures
JP2020000863A (ja) * 2018-06-26 2020-01-09 株式会社根本杏林堂 医用画像処理システム、医用画像処理方法および医用画像処理プログラム
WO2020026223A1 (en) * 2018-07-29 2020-02-06 Zebra Medical Vision Ltd. Systems and methods for automated detection of visual objects in medical images
JP2020029711A (ja) * 2018-08-22 2020-02-27 株式会社アールピージー・ラボ アドオン型制御器および制御システム

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9213405B2 (en) * 2010-12-16 2015-12-15 Microsoft Technology Licensing, Llc Comprehension and intent-based content for augmented reality displays
US10769797B2 (en) * 2017-01-05 2020-09-08 Samsung Electronics Co., Ltd. Virtual reality experience sharing
US10863159B2 (en) * 2017-01-20 2020-12-08 Pcms Holdings, Inc. Field-of-view prediction method based on contextual information for 360-degree VR video
CN107688348B (zh) * 2017-08-10 2020-10-20 中国科学院半导体研究所 一种实现指向控制功能的无线人机交互设备和方法
WO2019245862A1 (en) * 2018-06-19 2019-12-26 Tornier, Inc. Visualization of intraoperatively modified surgical plans

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2017010330A (ja) * 2015-06-23 2017-01-12 キヤノンマーケティングジャパン株式会社 医用画像処理システム、医用画像処理装置、その制御方法、及びプログラム
WO2017165301A1 (en) * 2016-03-21 2017-09-28 Washington University Virtual reality or augmented reality visualization of 3d medical images
US20180200018A1 (en) * 2016-03-21 2018-07-19 Washington University System and method for virtual reality data integration and visualization for 3d imaging and instrument position data
US20180075654A1 (en) * 2016-09-12 2018-03-15 Intel Corporation Hybrid rendering for a wearable display attached to a tethered computer
US20190365498A1 (en) * 2017-02-21 2019-12-05 Novarad Corporation Augmented Reality Viewing and Tagging For Medical Procedures
WO2019106014A1 (en) * 2017-12-01 2019-06-06 Sanofi Sensor system
WO2019185601A1 (en) * 2018-03-30 2019-10-03 Inflight VR Software GmbH Method, apparatus, and computer-readable medium for managing notifications delivered to a virtual reality device
JP2020000863A (ja) * 2018-06-26 2020-01-09 株式会社根本杏林堂 医用画像処理システム、医用画像処理方法および医用画像処理プログラム
WO2020026223A1 (en) * 2018-07-29 2020-02-06 Zebra Medical Vision Ltd. Systems and methods for automated detection of visual objects in medical images
JP2020029711A (ja) * 2018-08-22 2020-02-27 株式会社アールピージー・ラボ アドオン型制御器および制御システム

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ALEXANDER BORNIK,REINHARD BEICHEL,ERNST KRUIJFF,BERNHARD REITINGER,DIETER SCHMALSTIEG: ""A Hybrid User Interface for Manipulation of Volumetric Medical Data"", 3D USER INTERFACES (3DUI'06), JPN6025021375, 25 March 2006 (2006-03-25), pages 29 - 36, ISSN: 0005822154 *
VEERA BHADRA HARISH MANDALIKA,ALEXANDER I. CHERNOGLAZOV,MARK BILLINGHURST,CHRISTOPH BARTNECK,MICHAEL: ""A Hybrid 2D/3D User Interface for Radiological Diagnosis"", J DIGIT IMAGING(JOURNAL OF DIGITAL IMAGING);JOURNAL OF IMAGING INFORMATICS IN MEDICINE(SOCIETY FOR I, JPN6025021374, 1 August 2017 (2017-08-01), pages 56 - 73, ISSN: 0005822155 *

Also Published As

Publication number Publication date
EP4168880A1 (en) 2023-04-26
US20230230321A1 (en) 2023-07-20
EP3929702A1 (en) 2021-12-29
WO2021259724A1 (en) 2021-12-30
CA3187782A1 (en) 2021-12-30
CN115715386A (zh) 2023-02-24

Similar Documents

Publication Publication Date Title
JP2023530895A (ja) 拡張現実ベースのユーザインターフェースアドオン、３ｄ又は４ｄ医用画像データをレビューするためのシステム及び方法
Chheang et al. A collaborative virtual reality environment for liver surgery planning
JP7624975B2 (ja) 仮想マルチユーザコラボレーションにおいて医用画像データを分析するための方法、コンピュータプログラム、ユーザインターフェース、およびシステム
JP6883177B2 (ja) 解剖学的アイテムのコンピュータによる視覚化
US12186022B2 (en) Device and system for multidimensional data visualization and interaction in an augmented reality virtual reality or mixed reality image guided surgery
US11416069B2 (en) Device and system for volume visualization and interaction in a virtual reality or augmented reality environment
US12213750B2 (en) Device and system for multidimensional data visualization and interaction in an augmented reality virtual reality or mixed reality environment
JP3570576B2 (ja) マルチモダリティに対応した３次元画像合成表示装置
US10872460B1 (en) Device and system for volume visualization and interaction in a virtual reality or augmented reality environment
EP3912139A1 (en) Method of visualising a dynamic anatomical structure
JP2024537061A (ja) ３ｄ医用画像データを分析するための方法、コンピュータプログラム、及び３ｄ医用画像データ評価デバイス
US12354216B2 (en) Systems and methods for automated rendering
US10585552B2 (en) Distributed interactive medical visualization system with user interface features
Hachaj et al. Visualization of perfusion abnormalities with GPU-based volume rendering
Allison et al. MIXR: a standard architecture for medical image analysis in augmented and mixed reality
KR101903996B1 (ko) 의료 영상 시뮬레이션 방법 및 그 방법을 이용한 장치
JP2025540561A (ja) マルチボリュームレンダリングのためのシステムおよび方法
Fischer Rendering methods for augmented reality
Williams A method for viewing and interacting with medical volumes in virtual reality
US20260076754A1 (en) System and method for rendering operative guidance overlay
Grandi et al. Spatially aware mobile interface for 3d visualization and interactive surgery planning
JP7833617B2 (ja) セグメンテーションネットワーク同期のためのシステムおよび方法
US20250120816A1 (en) Systems and methods for generating patient-specific implants for anatomical structures of patients
Pes Augmented reality for surgical planning: integrating HoloLens 2 for 3D visualization and interaction with patient-specific anatomical models
Kirmizibayrak Interactive volume visualization and editing methods for surgical applications

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240610

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20240610

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20250428

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250603

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20250707

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20250715

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20250917

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20251219

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20260324