CN113906479A - 从局部深度图生成合成三维成像 - Google Patents

从局部深度图生成合成三维成像 Download PDF

Info

Publication number
CN113906479A
CN113906479A CN201980093251.XA CN201980093251A CN113906479A CN 113906479 A CN113906479 A CN 113906479A CN 201980093251 A CN201980093251 A CN 201980093251A CN 113906479 A CN113906479 A CN 113906479A
Authority
CN
China
Prior art keywords
point cloud
computer program
program product
model
depth
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201980093251.XA
Other languages
English (en)
Chinese (zh)
Inventor
瓦西里·叶夫根耶维奇·布哈林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ecotifer Surgical Co
Activ Surgical Inc
Original Assignee
Ecotifer Surgical Co
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ecotifer Surgical Co filed Critical Ecotifer Surgical Co
Publication of CN113906479A publication Critical patent/CN113906479A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—Three-dimensional [3D] image rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three-dimensional [3D] modelling for computer graphics
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20—Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30084—Kidney; Renal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/41—Medical
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/56—Particle system, point based geometry or rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2004—Aligning objects, relative positioning of parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Geometry (AREA)
  • Architecture (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Endoscopes (AREA)
CN201980093251.XA 2018-12-28 2019-12-27 从局部深度图生成合成三维成像 Pending CN113906479A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862785950P 2018-12-28 2018-12-28
US62/785,950 2018-12-28
PCT/US2019/068760 WO2020140044A1 (en) 2018-12-28 2019-12-27 Generation of synthetic three-dimensional imaging from partial depth maps

Publications (1)

Publication Number Publication Date
CN113906479A true CN113906479A (zh) 2022-01-07

Family

ID=71127363

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201980093251.XA Pending CN113906479A (zh) 2018-12-28 2019-12-27 从局部深度图生成合成三维成像

Country Status (7)

Country Link
US (1) US20220012954A1 (https=)
EP (1) EP3903281A4 (https=)
JP (1) JP2022516472A (https=)
KR (1) KR20210146283A (https=)
CN (1) CN113906479A (https=)
CA (1) CA3125288A1 (https=)
WO (1) WO2020140044A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240366162A1 (en) * 2021-09-02 2024-11-07 Koninklijke Philips N.V. Object visualisation in x-ray imaging

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7076447B2 (ja) 2016-11-24 2022-05-27 ユニヴァーシティ オブ ワシントン ヘッドマウントディスプレイのための光照射野キャプチャおよびレンダリング
EP3824621B1 (en) 2018-07-19 2025-06-11 Activ Surgical, Inc. Systems and methods for multi-modal sensing of depth in vision systems for automated surgical robots
US10623660B1 (en) 2018-09-27 2020-04-14 Eloupes, Inc. Camera array for a mediated-reality system
US10949986B1 (en) 2020-05-12 2021-03-16 Proprio, Inc. Methods and systems for imaging a scene, such as a medical scene, and tracking objects within the scene
US20220071711A1 (en) * 2020-09-04 2022-03-10 Karl Storz Se & Co. Kg Devices, systems, and methods for identifying unexamined regions during a medical procedure
CN113436211B (zh) * 2021-08-03 2022-07-15 天津大学 一种基于深度学习的医学图像活动轮廓分割方法
EP4427183A1 (en) * 2021-11-02 2024-09-11 Liveperson, Inc. Automated decisioning based on predicted user intent
US12261988B2 (en) 2021-11-08 2025-03-25 Proprio, Inc. Methods for generating stereoscopic views in multicamera systems, and associated devices and systems
WO2024077075A1 (en) * 2022-10-04 2024-04-11 Illuminant Surgical, Inc. Systems for projection mapping and markerless registration for surgical navigation, and methods of use thereof
WO2026042280A1 (ja) * 2024-08-23 2026-02-26 日本電気株式会社 内視鏡検査支援装置、内視鏡検査支援方法、及び、記録媒体

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100183236A1 (en) * 2009-01-21 2010-07-22 Samsung Electronics Co., Ltd. Method, medium, and apparatus of filtering depth noise using depth information
WO2017180097A1 (en) * 2016-04-12 2017-10-19 Siemens Aktiengesellschaft Deformable registration of intra and preoperative inputs using generative mixture models and biomechanical deformation
CN107292965A (zh) * 2017-08-03 2017-10-24 北京航空航天大学青岛研究院 一种基于深度图像数据流的虚实遮挡处理方法
US20180130255A1 (en) * 2016-11-04 2018-05-10 Aquifi, Inc. System and method for portable active 3d scanning
US20180261009A1 (en) * 2015-09-28 2018-09-13 Montefiore Medical Center Methods and devices for intraoperative viewing of patient 3d surfact images

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6879324B1 (en) * 1998-07-14 2005-04-12 Microsoft Corporation Regional progressive meshes
US20050253849A1 (en) * 2004-05-13 2005-11-17 Pixar Custom spline interpolation
WO2011151858A1 (ja) * 2010-05-31 2011-12-08 ビジュアツール株式会社 可視化用携帯端末装置、可視化プログラム及びボディ３ｄ計測システム
US20150086956A1 (en) * 2013-09-23 2015-03-26 Eric Savitsky System and method for co-registration and navigation of three-dimensional ultrasound and alternative radiographic data sets
US9524582B2 (en) * 2014-01-28 2016-12-20 Siemens Healthcare Gmbh Method and system for constructing personalized avatars using a parameterized deformable mesh
KR101671649B1 (ko) * 2014-12-22 2016-11-01 장석준 신체 데이터와 의류 데이터를 조합한 3d 합성 이미지 생성 방법 및 시스템
JP6706026B2 (ja) * 2015-04-01 2020-06-03 オリンパス株式会社 内視鏡システムおよび内視鏡装置の作動方法
JP6905323B2 (ja) * 2016-01-15 2021-07-21 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
CN116650106A (zh) * 2016-03-14 2023-08-29 穆罕默德·R·马赫福兹 用于无线超声跟踪和通信的超宽带定位
US10572720B2 (en) * 2017-03-01 2020-02-25 Sony Corporation Virtual reality-based apparatus and method to generate a three dimensional (3D) human face model using image and depth data
CN108694740A (zh) * 2017-03-06 2018-10-23 索尼公司 信息处理设备、信息处理方法以及用户设备
US10432913B2 (en) * 2017-05-31 2019-10-01 Proximie, Inc. Systems and methods for determining three dimensional measurements in telemedicine application
US11125861B2 (en) * 2018-10-05 2021-09-21 Zoox, Inc. Mesh validation
US10823855B2 (en) * 2018-11-19 2020-11-03 Fca Us Llc Traffic recognition and adaptive ground removal based on LIDAR point cloud statistics

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100183236A1 (en) * 2009-01-21 2010-07-22 Samsung Electronics Co., Ltd. Method, medium, and apparatus of filtering depth noise using depth information
US20180261009A1 (en) * 2015-09-28 2018-09-13 Montefiore Medical Center Methods and devices for intraoperative viewing of patient 3d surfact images
WO2017180097A1 (en) * 2016-04-12 2017-10-19 Siemens Aktiengesellschaft Deformable registration of intra and preoperative inputs using generative mixture models and biomechanical deformation
US20180130255A1 (en) * 2016-11-04 2018-05-10 Aquifi, Inc. System and method for portable active 3d scanning
CN107292965A (zh) * 2017-08-03 2017-10-24 北京航空航天大学青岛研究院 一种基于深度图像数据流的虚实遮挡处理方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
席小霞;宋文爱;邱子璇;史磊;: "基于RGB-D值的三维图像重建系统研究", 测试技术学报, no. 05, 30 October 2015 (2015-10-30) *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20240366162A1 (en) * 2021-09-02 2024-11-07 Koninklijke Philips N.V. Object visualisation in x-ray imaging
US12533091B2 (en) * 2021-09-02 2026-01-27 Koninklijke Philips N.V. Object visualisation in X-ray imaging

Also Published As

Publication number Publication date
JP2022516472A (ja) 2022-02-28
US20220012954A1 (en) 2022-01-13
EP3903281A1 (en) 2021-11-03
WO2020140044A1 (en) 2020-07-02
CA3125288A1 (en) 2020-07-02
EP3903281A4 (en) 2022-09-07
KR20210146283A (ko) 2021-12-03

Similar Documents

Publication Publication Date Title
US20220012954A1 (en) Generation of synthetic three-dimensional imaging from partial depth maps
US12400340B2 (en) User interface elements for orientation of remote camera during surgery
US8090174B2 (en) Virtual penetrating mirror device for visualizing virtual objects in angiographic applications
JP5675227B2 (ja) 内視鏡画像処理装置および作動方法、並びに、プログラム
CN102821671B (zh) 内窥镜观察支持系统和设备
CN119791847A (zh) 复合医学成像系统和方法
CN103200871B (zh) 图像处理系统、装置、方法以及医用图像诊断装置
US20220218435A1 (en) Systems and methods for integrating imagery captured by different imaging modalities into composite imagery of a surgical space
CN115298706A (zh) 用于在将合成元素应用于原始图像期间掩蔽所识别的对象的系统和方法
Kumar et al. Stereoscopic visualization of laparoscope image using depth information from 3D model
US20260044968A1 (en) Systems and methods for registering visual representations of a surgical space
US11941765B2 (en) Representation apparatus for displaying a graphical representation of an augmented reality
KR101977650B1 (ko) 증강 현실을 이용한 의료 영상 처리 장치 및 의료 영상 처리 방법
US10631948B2 (en) Image alignment device, method, and program
US10049480B2 (en) Image alignment device, method, and program
Hong et al. Colonoscopy simulation
Shoji et al. Camera motion tracking of real endoscope by using virtual endoscopy system and texture information
Habert et al. [POSTER] Augmenting Mobile C-arm Fluoroscopes via Stereo-RGBD Sensors for Multimodal Visualization
Kumar et al. Stereoscopic laparoscopy using depth information from 3D model
CN120694585A (zh) 腔体显示方法及装置、图像处理设备及存储介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20220107