JP2022516472A - 部分的深度マップからの合成３次元撮像の発生 - Google Patents

部分的深度マップからの合成３次元撮像の発生 Download PDF

Info

Publication number
JP2022516472A
JP2022516472A JP2021537826A JP2021537826A JP2022516472A JP 2022516472 A JP2022516472 A JP 2022516472A JP 2021537826 A JP2021537826 A JP 2021537826A JP 2021537826 A JP2021537826 A JP 2021537826A JP 2022516472 A JP2022516472 A JP 2022516472A
Authority
JP
Japan
Prior art keywords
point cloud
computer program
program product
model
various embodiments
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2021537826A
Other languages
English (en)
Japanese (ja)
Other versions
JPWO2020140044A5 (enExample
Inventor
ヴァシリー エフゲニエヴィチ ブハリン，
Original Assignee
アクティブ サージカル， インコーポレイテッド
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by アクティブ サージカル， インコーポレイテッド filed Critical アクティブ サージカル， インコーポレイテッド
Publication of JP2022516472A publication Critical patent/JP2022516472A/ja
Publication of JPWO2020140044A5 publication Critical patent/JPWO2020140044A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • G06T7/75—Determining position or orientation of objects or cameras using feature-based methods involving models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10028—Range image; Depth image; 3D point clouds
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30084—Kidney; Renal
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/41—Medical
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00—Indexing scheme for image generation or computer graphics
    • G06T2210/56—Particle system, point based geometry or rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2004—Aligning objects, relative positioning of parts
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Geometry (AREA)
  • Architecture (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Endoscopes (AREA)
JP2021537826A 2018-12-28 2019-12-27 部分的深度マップからの合成３次元撮像の発生 Pending JP2022516472A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201862785950P 2018-12-28 2018-12-28
US62/785,950 2018-12-28
PCT/US2019/068760 WO2020140044A1 (en) 2018-12-28 2019-12-27 Generation of synthetic three-dimensional imaging from partial depth maps

Publications (2)

Publication Number Publication Date
JP2022516472A true JP2022516472A (ja) 2022-02-28
JPWO2020140044A5 JPWO2020140044A5 (enExample) 2023-01-05

Family

ID=71127363

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2021537826A Pending JP2022516472A (ja) 2018-12-28 2019-12-27 部分的深度マップからの合成３次元撮像の発生

Country Status (7)

Country Link
US (1) US20220012954A1 (enExample)
EP (1) EP3903281A4 (enExample)
JP (1) JP2022516472A (enExample)
KR (1) KR20210146283A (enExample)
CN (1) CN113906479A (enExample)
CA (1) CA3125288A1 (enExample)
WO (1) WO2020140044A1 (enExample)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3545675A4 (en) 2016-11-24 2020-07-01 The University of Washington CAPTURE AND RESTITUTION OF LIGHT FIELD FOR HEADSETS
KR102545980B1 (ko) 2018-07-19 2023-06-21 액티브 서지컬, 인크. 자동화된 수술 로봇을 위한 비전 시스템에서 깊이의 다중 모달 감지를 위한 시스템 및 방법
US10623660B1 (en) 2018-09-27 2020-04-14 Eloupes, Inc. Camera array for a mediated-reality system
US10949986B1 (en) 2020-05-12 2021-03-16 Proprio, Inc. Methods and systems for imaging a scene, such as a medical scene, and tracking objects within the scene
US20220071711A1 (en) * 2020-09-04 2022-03-10 Karl Storz Se & Co. Kg Devices, systems, and methods for identifying unexamined regions during a medical procedure
CN113436211B (zh) * 2021-08-03 2022-07-15 天津大学 一种基于深度学习的医学图像活动轮廓分割方法
EP4144298A1 (en) * 2021-09-02 2023-03-08 Koninklijke Philips N.V. Object visualisation in x-ray imaging
CA3236816A1 (en) * 2021-11-02 2023-05-11 Angelo D'alessandro Automated decisioning based on predicted user intent
US12261988B2 (en) 2021-11-08 2025-03-25 Proprio, Inc. Methods for generating stereoscopic views in multicamera systems, and associated devices and systems
WO2024077075A1 (en) * 2022-10-04 2024-04-11 Illuminant Surgical, Inc. Systems for projection mapping and markerless registration for surgical navigation, and methods of use thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011151858A1 (ja) * 2010-05-31 2011-12-08 ビジュアツール株式会社 可視化用携帯端末装置、可視化プログラム及びボディ３ｄ計測システム
JP2016193144A (ja) * 2015-04-01 2016-11-17 オリンパス株式会社 内視鏡システムおよび計測方法
JP2017127623A (ja) * 2016-01-15 2017-07-27 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
US20180350073A1 (en) * 2017-05-31 2018-12-06 Proximie Inc. Systems and methods for determining three dimensional measurements in telemedicine application

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6879324B1 (en) * 1998-07-14 2005-04-12 Microsoft Corporation Regional progressive meshes
US20050253849A1 (en) * 2004-05-13 2005-11-17 Pixar Custom spline interpolation
KR101526866B1 (ko) * 2009-01-21 2015-06-10 삼성전자주식회사 깊이 정보를 이용한 깊이 노이즈 필터링 방법 및 장치
US20150086956A1 (en) * 2013-09-23 2015-03-26 Eric Savitsky System and method for co-registration and navigation of three-dimensional ultrasound and alternative radiographic data sets
US9524582B2 (en) * 2014-01-28 2016-12-20 Siemens Healthcare Gmbh Method and system for constructing personalized avatars using a parameterized deformable mesh
KR101671649B1 (ko) * 2014-12-22 2016-11-01 장석준 신체 데이터와 의류 데이터를 조합한 3d 합성 이미지 생성 방법 및 시스템
US10810799B2 (en) * 2015-09-28 2020-10-20 Montefiore Medical Center Methods and devices for intraoperative viewing of patient 3D surface images
CN116650106A (zh) * 2016-03-14 2023-08-29 穆罕默德·R·马赫福兹 用于无线超声跟踪和通信的超宽带定位
WO2017180097A1 (en) * 2016-04-12 2017-10-19 Siemens Aktiengesellschaft Deformable registration of intra and preoperative inputs using generative mixture models and biomechanical deformation
US10204448B2 (en) * 2016-11-04 2019-02-12 Aquifi, Inc. System and method for portable active 3D scanning
US10572720B2 (en) * 2017-03-01 2020-02-25 Sony Corporation Virtual reality-based apparatus and method to generate a three dimensional (3D) human face model using image and depth data
CN108694740A (zh) * 2017-03-06 2018-10-23 索尼公司 信息处理设备、信息处理方法以及用户设备
CN107292965B (zh) * 2017-08-03 2020-10-13 北京航空航天大学青岛研究院 一种基于深度图像数据流的虚实遮挡处理方法
US11125861B2 (en) * 2018-10-05 2021-09-21 Zoox, Inc. Mesh validation
US10823855B2 (en) * 2018-11-19 2020-11-03 Fca Us Llc Traffic recognition and adaptive ground removal based on LIDAR point cloud statistics

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011151858A1 (ja) * 2010-05-31 2011-12-08 ビジュアツール株式会社 可視化用携帯端末装置、可視化プログラム及びボディ３ｄ計測システム
JP2016193144A (ja) * 2015-04-01 2016-11-17 オリンパス株式会社 内視鏡システムおよび計測方法
JP2017127623A (ja) * 2016-01-15 2017-07-27 キヤノン株式会社 画像処理装置、画像処理方法、およびプログラム
US20180350073A1 (en) * 2017-05-31 2018-12-06 Proximie Inc. Systems and methods for determining three dimensional measurements in telemedicine application

Also Published As

Publication number Publication date
KR20210146283A (ko) 2021-12-03
WO2020140044A1 (en) 2020-07-02
EP3903281A1 (en) 2021-11-03
CA3125288A1 (en) 2020-07-02
EP3903281A4 (en) 2022-09-07
US20220012954A1 (en) 2022-01-13
CN113906479A (zh) 2022-01-07

Similar Documents

Publication Publication Date Title
US20220012954A1 (en) Generation of synthetic three-dimensional imaging from partial depth maps
US8090174B2 (en) Virtual penetrating mirror device for visualizing virtual objects in angiographic applications
US12400340B2 (en) User interface elements for orientation of remote camera during surgery
JP5153620B2 (ja) 連続的にガイドされる内視鏡と関係する画像を重ね合わせるためのシステム
EP2883353B1 (en) System and method of overlaying images of different modalities
CN114126527B (zh) 复合医学成像系统和方法
CN102821671B (zh) 内窥镜观察支持系统和设备
EP2573735B1 (en) Endoscopic image processing device, method and program
JP2008532612A (ja) 診療処理中の３次元ボリュームデータとの２次元情報の位置合わせのための画像処理システム及び方法
EP4094184A1 (en) Systems and methods for masking a recognized object during an application of a synthetic element to an original image
US9911225B2 (en) Live capturing of light map image sequences for image-based lighting of medical data
Ben-Hamadou et al. Construction of extended 3D field of views of the internal bladder wall surface: a proof of concept
US10049480B2 (en) Image alignment device, method, and program
US10631948B2 (en) Image alignment device, method, and program
Shoji et al. Camera motion tracking of real endoscope by using virtual endoscopy system and texture information
JP7566013B2 (ja) 拡張現実における医療用ビューの配置
Habert et al. [POSTER] Augmenting Mobile C-arm Fluoroscopes via Stereo-RGBD Sensors for Multimodal Visualization
Eck et al. Display technologies
Westwood Development of a 3D visualization system for surgical field deformation with geometric pattern projection
CN120694585A (zh) 腔体显示方法及装置、图像处理设备及存储介质
WO2023039059A1 (en) Method of robust surface and depth estimation
Chung Calibration of Optical See-Through Head Mounted Display with Mobile C-arm for Visualization of Cone Beam CT Data

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221222

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20221222

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20231115

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20231117

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20240216

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20240607