WO2004047030A2 - Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object - Google Patents

Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object Download PDF

Info

Publication number
WO2004047030A2
WO2004047030A2 PCT/IB2003/005168 IB0305168W WO2004047030A2 WO 2004047030 A2 WO2004047030 A2 WO 2004047030A2 IB 0305168 W IB0305168 W IB 0305168W WO 2004047030 A2 WO2004047030 A2 WO 2004047030A2
Authority
WO
WIPO (PCT)
Prior art keywords
model
image
resolution
confidence
feature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2003/005168
Other languages
English (en)
French (fr)
Other versions
WO2004047030A3 (en
Inventor
Maxim Fradkin
Jean-Michel Rouet
Shérif Makram-Ebeid
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Priority to JP2004553008A priority Critical patent/JP2006506164A/ja
Priority to AU2003278538A priority patent/AU2003278538A1/en
Priority to DE60311865T priority patent/DE60311865T2/de
Priority to US10/535,466 priority patent/US8437579B2/en
Priority to EP03769837A priority patent/EP1565880B1/en
Publication of WO2004047030A2 publication Critical patent/WO2004047030A2/en
Publication of WO2004047030A3 publication Critical patent/WO2004047030A3/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/12Edge-based segmentation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/149Segmentation; Edge detection involving deformable models, e.g. active contour models
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10116X-ray image
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing

Definitions

  • an object of the invention proposes an image processing system having image data processing means for automatic adaptation of the mapping of a 3-D Mesh Model onto a three dimensional surface of an object represented in a gray level image; and having viewing means for displaying quantified and visual indications of the confidence of such a Mesh Model adaptation onto said object surface, in a coded manner, preferably in a color coded manner.
  • the system processing means uses the system processing means, the three-dimensional surface of the three dimensional object of interest is registered in a three dimensional gray level image.
  • the three dimensional Simplex Mesh Model is fitted onto the three dimensional surface according to a mesh model technique for fitting at best said surface.
  • FIG. IB represents an object of interest (an organ) with a Mesh Model (a sphere) for segmenting this object using a Mesh Model deformation technique and the adaptation technique of the invention
  • the complex surface OBJ poses a problem when the segmentation method described above is applied.
  • the present invention is able to solve this problem.
  • the surface denoted by OBJ, represented in FIG.IA and IB, has been chosen in order to demonstrate that the method of the invention may be applied to a great number of different and complex surfaces.
  • the image segmentation method is based on utilization of discrete deformable models, like 2-Simplex Meshes Model described as prior art [Delingette].
  • a three dimensional digital Simplex Mesh Model is generated as illustrated by FIG.1 A or FIG. IB.
  • This refinement consists in introducing an algorithm for automatically increasing the Mesh resolution at parts of high curvature and at parts whose distance to the image data is higher than a threshold. Hence, at each iteration, the area of the spherical cells decreases. So, according to the known technique, since when the distance to the image data is large, as shown in FIG.IA, the surface of the cells decreases and the number of cells increases, the refinement algorithm would be unable to improve the result in said parts P'l, P'2.
  • the automated technique of estimation of the adaptation comprises sub-steps of: 4.1) Constructing a Color Coding Table wherein predetermined colors are associated with given feature confidence for model adaptation represented by the confidence parameter.
  • the present invention provides a visualization of the cells that are color coded in function of the confidence parameter. This visualization with different colors allows to supervise the deformation process and to locally assess its final quality.
  • a predetermined color may be associated to one confidence parameter value; colors maybe classified in classes of colors, each class of colors corresponding to a range of confidence parameter values; each class of color may further be sub-divided according to a scale of hues for sub-dividing the range of confidence parameter values;
  • FIG.3 shows a diagram of an image processing system 150 according to the invention for carrying out all the steps of the above-described method.
  • the system has means 151 for acquiring digital image data of a sequence of images, and is coupled to computer means 153 for processing these data according to the processing steps of the method cited above.
  • the medical viewing system can be used in the intervention room or near the intervention room for processing real time images. Steps of the present method can be applied on stored medical images, for example for estimating medical parameters.
  • the medical viewing system provides the image data by connection 157 to the system 153.
  • the system provides processed image data to display means and/or storage means.
  • the display means 154 may be a screen.
  • the storage means may be a memory of the system 153. Said storage means may be alternately external storage means.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Geometry (AREA)
  • Image Processing (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Image Analysis (AREA)
  • Processing Or Creating Images (AREA)
  • Heating, Cooling, Or Curing Plastics Or The Like In General (AREA)
  • Coating With Molten Metal (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Image Generation (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
PCT/IB2003/005168 2002-11-20 2003-11-14 Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object Ceased WO2004047030A2 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
JP2004553008A JP2006506164A (ja) 2002-11-20 2003-11-14 3次元メッシュモデルをオブジェクトの3次元表面に自動的に適応させる画像処理システム
AU2003278538A AU2003278538A1 (en) 2002-11-20 2003-11-14 Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object
DE60311865T DE60311865T2 (de) 2002-11-20 2003-11-14 Bildverarbeitungssystem zur automatischen anpassung eines 3d-maschenmodels auf eine 3d-objektfläche
US10/535,466 US8437579B2 (en) 2002-11-20 2003-11-14 Image processing system for automatic adaptation of a 3-D mesh model onto a 3-D surface of an object
EP03769837A EP1565880B1 (en) 2002-11-20 2003-11-14 Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP02292884.0 2002-11-20
EP02292884 2002-11-20

Publications (2)

Publication Number Publication Date
WO2004047030A2 true WO2004047030A2 (en) 2004-06-03
WO2004047030A3 WO2004047030A3 (en) 2004-10-07

Family

ID=32319683

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2003/005168 Ceased WO2004047030A2 (en) 2002-11-20 2003-11-14 Image processing system for automatic adaptation of a 3-d mesh model onto a 3-d surface of an object

Country Status (7)

Country Link
US (1) US8437579B2 (enExample)
EP (1) EP1565880B1 (enExample)
JP (1) JP2006506164A (enExample)
AT (1) ATE354140T1 (enExample)
AU (1) AU2003278538A1 (enExample)
DE (1) DE60311865T2 (enExample)
WO (1) WO2004047030A2 (enExample)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2460411A (en) * 2008-05-27 2009-12-02 Simpleware Ltd Variable mesh resolution in medical image generation
WO2010046819A1 (en) * 2008-10-22 2010-04-29 Koninklijke Philips Electronics N.V. 3-d ultrasound imaging
US8526697B2 (en) 2008-02-15 2013-09-03 Koninklijke Philips N.V. Apparatus for segmenting an object comprising sub-objects
GB2539963A (en) * 2015-07-03 2017-01-04 Williams Justin Thermographic imaging system
WO2017001476A1 (en) 2015-06-29 2017-01-05 Koninklijke Philips N.V. Interactive mesh editing
US10346708B2 (en) 2013-06-25 2019-07-09 Synopsys, Inc. Image processing method
US12211147B2 (en) 2019-12-19 2025-01-28 Koninklijke Philips N.V. Mesh correction depending on mesh normal direction

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9953040B2 (en) * 2007-08-01 2018-04-24 Koninklijke Philips N.V. Accessing medical image databases using medically relevant terms
RU2505860C2 (ru) * 2008-04-04 2014-01-27 Конинклейке Филипс Электроникс Н.В. Одновременная основанная на модели сегментация объектов, удовлетворяющих заранее заданным пространственным соотношениям
EP2279489B1 (en) * 2008-04-07 2019-06-12 Koninklijke Philips N.V. Mesh collision avoidance
US8265363B2 (en) * 2009-02-04 2012-09-11 General Electric Company Method and apparatus for automatically identifying image views in a 3D dataset
EP2617010B1 (en) * 2010-09-17 2017-07-26 Koninklijke Philips Electronics N.V. Choosing anatomical variant model for image segmentation
US8903088B2 (en) 2011-12-02 2014-12-02 Adobe Systems Incorporated Binding of protected video content to video player with encryption key
US8879731B2 (en) 2011-12-02 2014-11-04 Adobe Systems Incorporated Binding of protected video content to video player with block cipher hash
US9064318B2 (en) 2012-10-25 2015-06-23 Adobe Systems Incorporated Image matting and alpha value techniques
US10638221B2 (en) 2012-11-13 2020-04-28 Adobe Inc. Time interval sound alignment
US9201580B2 (en) 2012-11-13 2015-12-01 Adobe Systems Incorporated Sound alignment user interface
US9355649B2 (en) 2012-11-13 2016-05-31 Adobe Systems Incorporated Sound alignment using timing information
KR101339552B1 (ko) * 2012-11-15 2013-12-10 이화여자대학교 산학협력단 사용자 기반의 오브젝트 근사 방법 및 오브젝트 근사 시스템
US9076205B2 (en) 2012-11-19 2015-07-07 Adobe Systems Incorporated Edge direction and curve based image de-blurring
US10249321B2 (en) 2012-11-20 2019-04-02 Adobe Inc. Sound rate modification
US9451304B2 (en) 2012-11-29 2016-09-20 Adobe Systems Incorporated Sound feature priority alignment
US9135710B2 (en) * 2012-11-30 2015-09-15 Adobe Systems Incorporated Depth map stereo correspondence techniques
US10455219B2 (en) 2012-11-30 2019-10-22 Adobe Inc. Stereo correspondence and depth sensors
US10249052B2 (en) 2012-12-19 2019-04-02 Adobe Systems Incorporated Stereo correspondence model fitting
US9208547B2 (en) 2012-12-19 2015-12-08 Adobe Systems Incorporated Stereo correspondence smoothness tool
US9214026B2 (en) 2012-12-20 2015-12-15 Adobe Systems Incorporated Belief propagation and affinity measures
EP3251096B1 (en) 2015-01-28 2024-07-10 Koninklijke Philips N.V. Finite element modeling of anatomical structure
US10915680B2 (en) * 2018-12-21 2021-02-09 Dassault Systemes Simulia Corp. Local control of design patterns on surfaces for enhanced physical properties

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE69331719T2 (de) * 1992-06-19 2002-10-24 Agfa-Gevaert, Mortsel Verfahren und Vorrichtung zur Geräuschunterdrückung
AU6108396A (en) 1995-06-07 1996-12-30 David M. Geshwind Systems using motion detection, interpolation, and cross-dis solving for improving picture quality
AU2454397A (en) * 1996-04-24 1997-11-12 Shriners Hospital For Children Method and apparatus for recording three-dimensional topographies
US6404920B1 (en) 1996-09-09 2002-06-11 Hsu Shin-Yi System for generalizing objects and features in an image
US5886702A (en) * 1996-10-16 1999-03-23 Real-Time Geometry Corporation System and method for computer modeling of 3D objects or surfaces by mesh constructions having optimal quality characteristics and dynamic resolution capabilities
GB9626676D0 (en) 1996-12-23 1997-02-12 Smith & Nephew Res Imaging method
US6351262B1 (en) 1998-06-30 2002-02-26 Lucent Technologies, Inc. Display techniques for three-dimensional virtual reality
JP2000175052A (ja) 1998-12-07 2000-06-23 Xerox Corp ピクセルマップ表現の処理方法及び装置
US6968299B1 (en) * 2000-04-14 2005-11-22 International Business Machines Corporation Method and apparatus for reconstructing a surface using a ball-pivoting algorithm
EP1371013B1 (en) * 2001-03-09 2017-04-12 Koninklijke Philips N.V. Image segmentation

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8526697B2 (en) 2008-02-15 2013-09-03 Koninklijke Philips N.V. Apparatus for segmenting an object comprising sub-objects
GB2460411A (en) * 2008-05-27 2009-12-02 Simpleware Ltd Variable mesh resolution in medical image generation
GB2460411B (en) * 2008-05-27 2012-08-08 Simpleware Ltd Image processing method
US8384716B2 (en) 2008-05-27 2013-02-26 Simpleware Limited Image processing method
WO2010046819A1 (en) * 2008-10-22 2010-04-29 Koninklijke Philips Electronics N.V. 3-d ultrasound imaging
US10346708B2 (en) 2013-06-25 2019-07-09 Synopsys, Inc. Image processing method
WO2017001476A1 (en) 2015-06-29 2017-01-05 Koninklijke Philips N.V. Interactive mesh editing
GB2539963A (en) * 2015-07-03 2017-01-04 Williams Justin Thermographic imaging system
US12211147B2 (en) 2019-12-19 2025-01-28 Koninklijke Philips N.V. Mesh correction depending on mesh normal direction

Also Published As

Publication number Publication date
DE60311865D1 (de) 2007-03-29
ATE354140T1 (de) 2007-03-15
EP1565880A2 (en) 2005-08-24
DE60311865T2 (de) 2007-10-31
AU2003278538A1 (en) 2004-06-15
US20060078194A1 (en) 2006-04-13
WO2004047030A3 (en) 2004-10-07
AU2003278538A8 (en) 2004-06-15
US8437579B2 (en) 2013-05-07
JP2006506164A (ja) 2006-02-23
EP1565880B1 (en) 2007-02-14

Similar Documents

Publication Publication Date Title
US8437579B2 (en) Image processing system for automatic adaptation of a 3-D mesh model onto a 3-D surface of an object
US7043062B2 (en) Image processing method for displaying an image sequence of a deformable 3-D object with indications of the object wall motion
EP1685534B1 (en) Three-dimensional segmentation using deformable surfaces
Park et al. A non-self-intersecting adaptive deformable surface for complex boundary extraction from volumetric images
JP3712234B2 (ja) 関心領域抽出方法及び画像処理サーバ
WO2003005298A2 (en) Image processing method for interacting with a 3-d surface represented in a 3-d image
JP4170096B2 (ja) 対象の3次元表面上にマップされた3次元メッシュモデルの適合性評価のための画像処理装置
JP7456928B2 (ja) 胸部x線画像の異常表示制御方法、異常表示制御プログラム、異常表示制御装置、及びサーバ装置
US6434260B1 (en) Facial imaging in utero
WO2005078666A1 (en) Real time user interaction with deformable surfaces of segmentation
CA2617227C (en) Deformable model for segmenting patient contours versus support structures in medical images
EP2074591B1 (en) Methods, system and computer program product for detecting a protrusion
EP1141894B1 (en) Method and apparatus for processing images with regions representing target objects
Akkasaligar et al. Analysis of polycystic kidney disease in medical ultrasound images
WO2011127940A1 (en) Method for segmentation of objects from a three dimensional image data set with a deformable model
EP4521355A1 (en) Correcting topological defects on a surface mesh representing an organ
Jackowski et al. A computer-aided design system for segmentation of volumetric images
WO2007096453A1 (en) Method and system for reconstructing a model of an object
Bertolotti Automatic segmentation of pelvic floor ring on 3D ultrasound
Bankhele et al. Detection of Protrusion on Curved Folded Surface In Colon Capsule Endoscopy

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2003769837

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2006078194

Country of ref document: US

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 10535466

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 2004553008

Country of ref document: JP

WWP Wipo information: published in national office

Ref document number: 2003769837

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 10535466

Country of ref document: US

WWG Wipo information: grant in national office

Ref document number: 2003769837

Country of ref document: EP